-- Logs begin at Fri 2022-08-05 18:48:17 UTC, end at Fri 2022-08-05 20:23:02 UTC. -- Aug 05 19:55:36.769458 dv-cinder-852211-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 19:55:36.778487 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 19:55:36 2022] *** Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: nodename: dv-cinder-852211-3-iscsi Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: machine: x86_64 Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: clock source: unix Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: pcre jit disabled Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: detected number of CPU cores: 4 Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: current working directory: / Aug 05 19:55:36.780489 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: detected binary path: /usr/bin/uwsgi-core Aug 05 19:55:36.781117 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: your processes number limit is 47680 Aug 05 19:55:36.781117 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: your memory page size is 4096 bytes Aug 05 19:55:36.781117 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: detected max file descriptor number: 2048 Aug 05 19:55:36.781117 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: lock engine: pthread robust mutexes Aug 05 19:55:36.781117 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: thunder lock: enabled Aug 05 19:55:36.781117 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 19:55:36.781117 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 19:55:36.822311 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: Python main interpreter initialized at 0x55f2579219c0 Aug 05 19:55:36.822311 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: python threads support enabled Aug 05 19:55:36.822311 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: your server socket listen backlog is limited to 100 connections Aug 05 19:55:36.822311 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: your mercy for graceful operations on workers is 90 seconds Aug 05 19:55:36.822716 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 19:55:36.822716 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: *** Operational MODE: preforking *** Aug 05 19:55:36.822983 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: *** uWSGI is running in multiple interpreter mode *** Aug 05 19:55:36.822983 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: spawned uWSGI master process (pid: 103671) Aug 05 19:55:36.823191 dv-cinder-852211-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 19:55:36.824526 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: spawned uWSGI worker 1 (pid: 103672, cores: 1) Aug 05 19:55:36.824526 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: spawned uWSGI worker 2 (pid: 103673, cores: 1) Aug 05 19:55:36.824526 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 19:55:37.494694 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 19:55:37.513445 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 19:55:38.604400 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:55:38.604400 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: from cryptography.utils import int_from_bytes Aug 05 19:55:38.605108 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:55:38.605108 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: from cryptography.utils import int_from_bytes Aug 05 19:55:38.654343 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:55:38.654343 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: from cryptography.utils import int_from_bytes Aug 05 19:55:38.654945 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:55:38.654945 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: from cryptography.utils import int_from_bytes Aug 05 19:55:41.120237 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:55:41.120824 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:55:41.121019 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:55:41.121371 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:55:41.121648 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:55:41.122059 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.122407 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.122701 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:55:41.123057 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.123146 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:55:41.123224 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.123369 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.123465 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:55:41.123676 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.123849 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:55:41.124021 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.124121 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:55:41.124337 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.124484 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.124662 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.124813 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.124920 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.125137 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.125231 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.125458 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.125545 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-3-iscsi {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.125794 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.125928 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.126103 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.126202 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.126420 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.126517 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.126730 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.126832 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.127587 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.127823 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.127982 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.128288 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.128381 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.128688 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.128819 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.129025 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-3-iscsi {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.129295 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.129397 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.129616 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.129721 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.129953 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.130039 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.130271 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.130356 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.130579 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.130690 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.130912 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.131005 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.131227 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.131314 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.131581 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.131728 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.131997 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.132093 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.132333 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.132436 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.132670 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.132763 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-3-iscsi {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.133008 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.133096 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.133321 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.133408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.133631 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.133738 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.133951 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.134173 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.134267 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.134533 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.134620 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.134865 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.134977 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.135199 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.135290 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-3-iscsi {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.135521 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.135616 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.135848 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.135944 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.136179 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.136272 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.136497 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.136583 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.136815 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.136902 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.137134 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.137269 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.137434 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.137560 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.137743 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.137836 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.138052 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.138152 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.138369 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.138457 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.138675 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.138767 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.138978 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.139088 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.139227 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.139319 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.139543 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.139648 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.139891 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.140002 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.140209 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.140303 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.140529 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.140617 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.140780 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.140867 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.141032 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.141155 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.141349 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.141446 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.141660 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.141751 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.141966 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.142055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.142275 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.142372 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.142670 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.142797 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.142990 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.143097 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.143475 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.143584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.143724 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.143874 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.144073 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.144169 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.144386 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.144483 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.144698 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.144792 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.145010 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.145133 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.145318 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.145406 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.145626 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.145717 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.145935 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.146016 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.146242 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.146339 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.95 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.146550 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.146649 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.95 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.146863 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.146948 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.147175 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.147262 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.147497 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.147582 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.147821 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.147910 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.148145 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.148239 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.148465 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.148549 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.95 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.148774 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.148867 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.95 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.149079 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.149171 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.149387 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.149472 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.149712 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.149807 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.150017 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.150105 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.150333 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.150424 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.150602 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.150698 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.150923 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.151008 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.151246 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.151336 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.151557 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.151652 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.151902 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.152003 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.152234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.152318 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.152538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.152635 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.152789 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.152895 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.153090 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.153217 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.153399 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.153559 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.153719 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.153912 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.154029 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.154276 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.154400 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.154630 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.154722 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.154931 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.155018 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.155237 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.155336 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.155543 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.155632 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.155873 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.155976 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.156183 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.156319 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.156490 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.156632 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.156792 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.156981 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.157100 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.157306 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.157426 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.157652 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.157750 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.157999 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.158112 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.158721 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.158934 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.159098 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.159259 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.159445 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.159612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.159838 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.159962 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.160146 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.160258 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.160482 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.160609 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.160818 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.160950 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.161166 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.161331 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.161489 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.161586 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.161797 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.161883 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.162104 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.162192 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.162425 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.162525 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.162735 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.162821 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.163043 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.163135 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.163346 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.163439 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.163650 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.163744 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.163982 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.164068 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.164284 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.164382 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.164589 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.164681 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.164890 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.164976 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.165192 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.165277 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.165488 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.165571 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.165791 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.165882 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.166096 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.166183 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.166399 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.166483 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.166701 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.166793 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.167000 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.167086 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.167319 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.167446 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.167639 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.167736 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.167973 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.168061 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.168282 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.168367 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.168586 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.168726 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.168903 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:55:41.168989 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.169240 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.169325 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.169566 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.169663 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.169879 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.169965 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.170193 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.170286 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.170517 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.170612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.170825 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.170926 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.171133 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.171220 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.171442 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.171528 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.171760 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.171911 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.172108 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.172193 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.172420 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.172507 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.172732 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.172855 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.173034 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.173125 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.173363 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.173462 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.173668 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.174292 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.174513 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.174738 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.174851 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.175147 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.175281 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.175454 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.175607 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.175823 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.175962 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.176153 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.176279 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.176463 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.176603 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.176784 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.176937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.177105 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.177261 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.177413 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.177577 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.177719 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.177957 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.178062 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.178333 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.178431 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.178647 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.178786 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.178973 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.179058 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.179295 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.179390 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.179610 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.179709 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.179949 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.180037 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.180271 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.180393 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.180595 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.180695 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.180932 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.181019 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.181249 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.181346 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.181573 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.181680 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.181888 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.181976 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.182207 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.182325 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.182520 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.182695 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.182836 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.183013 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.183152 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.183327 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.183492 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.183673 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.183828 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.184041 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.184131 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.184365 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.184467 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.184689 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.184776 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.185047 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.185135 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.185361 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.185457 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.185676 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.185763 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.185983 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.186098 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.186288 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.186425 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.186593 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.186805 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.186894 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.187120 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.187214 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.187430 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.187523 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.187738 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.187837 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.188069 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.188167 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.188376 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.188461 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.188686 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.188773 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.188993 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.189092 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.189295 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.189446 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.190322 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.190476 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.190588 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.190877 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.190967 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.191207 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.191298 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.191508 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.191617 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.191903 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.191988 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.192137 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.192223 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.192446 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.192547 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.192756 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.192856 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.193066 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.193159 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.193374 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.193469 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.193679 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.193765 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.193995 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.194088 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.194303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.194389 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.194619 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.194712 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.194935 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.195028 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.195243 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.195328 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.195566 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.195658 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.195910 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.196011 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.196225 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.196310 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.196529 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.196622 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.196839 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.196925 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.197144 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.197231 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.197448 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.197534 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.197751 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.197845 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.198058 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.198151 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.198358 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.198444 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.198661 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.198762 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.198963 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.199049 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.199266 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.199361 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.199569 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.199736 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.199906 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.200004 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.200211 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.200296 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.200513 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.200613 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.200813 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.200900 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.201115 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.201199 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.201419 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.201507 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.201740 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.201823 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.202047 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.202142 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.202353 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.202440 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.202657 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.202750 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.202962 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.203047 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.203306 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.203391 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.203611 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.203696 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.203944 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.204030 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.204256 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.204343 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.204590 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.204678 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.204920 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.205077 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.205393 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.205481 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.205728 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.205939 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.206070 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.206422 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.206509 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.206759 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.206833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.207121 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.207210 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.207403 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.207489 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.207725 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.207856 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.208068 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.208145 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.208393 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.208481 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.208751 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.208840 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.209037 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.209118 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.209347 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.209424 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.209672 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.209756 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.209985 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.210075 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.210307 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.210390 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.210651 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.210728 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.210990 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.211081 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.211311 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.211399 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.211635 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.211719 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.212037 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.212139 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.212289 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.212366 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.212599 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.212682 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.212915 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.213003 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.213229 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.213312 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.213542 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.213618 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.213865 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.213944 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.214178 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.214262 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.214499 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.214584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.214810 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.214949 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.215134 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.215282 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.215445 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.215615 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.215766 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.215964 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.216090 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.216296 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.216406 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.216611 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.216737 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.216920 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.217072 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.217226 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.217383 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.217531 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.217698 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.217837 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.218018 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.218148 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.218328 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.218457 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.218638 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.218764 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.218948 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.219065 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.219255 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.219382 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.219559 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.219724 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.219896 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.220025 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.220211 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.220312 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.220519 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.220756 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.220962 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.221096 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.221382 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.221477 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.221702 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.221788 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.222022 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.222123 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.222328 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.222426 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.222628 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.222725 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.222949 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.223047 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.223257 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.223344 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.223560 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.223646 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.223898 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.223990 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.224204 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.224292 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.224547 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.224633 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.224853 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.224937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.225157 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.225254 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.225473 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.225606 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.225788 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.225891 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.226094 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.226181 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.226406 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.226492 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.226714 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.226813 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.227020 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.227120 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.227339 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.227432 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.227663 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.227812 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.228009 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.228106 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.228326 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.228423 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.228645 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.228778 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.228952 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.229071 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.229262 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.229381 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.229568 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.229697 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.229896 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.229991 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.230206 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.230337 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.230523 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.230708 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.230830 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.231048 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.231179 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.231386 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.231486 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.231728 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.231893 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.232059 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.232427 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.232529 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.232671 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.232817 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.232973 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.233059 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.233287 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.233392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.233600 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.233734 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.234032 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.234176 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.234387 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.234512 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.234768 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.234863 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.235133 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.235250 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.235441 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.235570 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.235756 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.235912 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.236096 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.236195 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.236949 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.237123 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.237264 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.237572 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.237720 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.237880 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.238040 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.238184 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.238357 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.238493 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.238667 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.238794 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.238975 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.239096 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.239290 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.239385 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.239598 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.239691 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.239939 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.240028 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.240247 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.240346 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.240604 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.240750 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.240900 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.240997 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.241221 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.241309 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.241524 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.241608 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.241824 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.241908 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.242124 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.242211 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.242425 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.242578 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.242740 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.242836 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.243045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.243132 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.243369 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.243456 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.243680 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.243792 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.244012 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.244099 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.244316 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.244410 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.244620 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.244720 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.244939 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.245024 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.245240 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.245333 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.245543 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.245638 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.245843 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.245930 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.246147 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.246233 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.246450 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.246551 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.246748 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.246841 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.247056 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.247141 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.247362 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.247456 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.247682 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.247770 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.248037 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.248147 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.248348 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.248478 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.248654 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.248749 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.248961 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.249070 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.249274 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.249370 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.249587 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.249684 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.249903 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.250046 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.250208 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.250286 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.250518 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.250632 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.250824 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.250961 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.251127 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.251261 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.251443 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.251540 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.251744 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.251925 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.252258 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.252401 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.252582 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.252787 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.252934 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.253109 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.253293 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.253431 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.253612 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.253727 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.253976 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.254121 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.254335 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.254470 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.254655 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.254782 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.255014 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.255217 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.255363 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.255510 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.255603 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.255694 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.255933 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.256025 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.256236 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.256322 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.256551 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.256636 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.256861 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.256949 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.257178 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.257270 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.257484 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.257570 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.257783 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.257912 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.258090 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.258179 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.258392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.258496 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.258693 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.258781 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.258993 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.259079 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.259302 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.259398 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.259601 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.259696 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.259926 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.260016 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.260230 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.260329 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.260532 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.260618 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.260831 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.260925 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.261179 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.261282 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.261484 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.261569 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.261788 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.261874 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.262091 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.262185 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.262392 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.262478 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.262696 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.262828 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.263002 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.263092 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.263327 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.263414 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.263639 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.263726 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.263972 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.264061 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.264280 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.264375 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.264587 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.264673 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.264895 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.264981 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.265224 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.265311 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.265526 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.265611 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.265839 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.265926 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.266150 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.266236 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.266461 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.266557 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.266764 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.266851 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.267067 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.267153 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.267389 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.268124 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.268268 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.268455 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.268582 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.268904 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.268989 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.269226 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.269313 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.269548 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.269637 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.269861 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.269946 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.270172 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.270261 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.270507 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.270595 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.270827 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.270914 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.271144 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.271275 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.271471 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.271594 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.271870 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.272282 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.272376 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.272616 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.272751 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.272881 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.272963 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.273103 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.273194 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.273262 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.273431 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.273580 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.273744 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.273915 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.274057 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.274299 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.274387 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.274627 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.274724 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.274973 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.275068 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.275289 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.275375 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.275603 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.275698 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.275938 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.276039 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.276244 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.276330 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.276553 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.276647 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.276856 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.276942 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.277182 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.277274 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.277495 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.277630 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.277801 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.277944 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.278110 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.278255 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.278419 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.278547 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.278731 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.278858 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.279035 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.279175 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.279471 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.279559 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.279808 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.279895 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.280122 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.280208 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.280438 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.280526 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.280754 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.280839 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.281069 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.281156 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.281387 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.281473 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.281695 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.281779 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.282001 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.282097 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.282323 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.282408 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.282626 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.282711 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.282928 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.283022 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.283918 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.284048 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.284329 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.284607 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.284749 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.284930 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.285082 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.285254 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.285502 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.285591 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.285816 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.285982 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.286123 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.286210 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.286475 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.286570 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.286806 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.286893 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.287115 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.287202 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.287443 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.287595 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.287759 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.287905 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.288106 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.288268 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.288412 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.288578 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.288726 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.288999 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.289086 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.289314 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.289400 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.289630 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.289746 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.289959 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.290055 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.290269 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.290353 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.290572 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.290659 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.290892 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.290986 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.291207 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.291300 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.291516 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.291602 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.291862 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.291963 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.292192 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.292279 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.292509 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.292597 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.292824 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.292922 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.293129 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.293216 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.293454 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.293540 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.293776 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.293871 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.294087 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.294171 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.294413 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.294519 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.294736 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.294817 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.295066 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.295162 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.295433 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.295570 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.295757 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.295883 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.296108 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.296195 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.296417 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.296581 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.296725 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.296813 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.297035 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.297146 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.297340 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.297435 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.297648 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.297781 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.297973 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.298120 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.298278 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.298479 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.298613 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.298885 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.298978 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.299415 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.299514 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.299797 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.299963 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.300162 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.300281 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.300495 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.300595 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.300827 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.300914 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.301157 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.301245 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.301492 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.301593 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.301826 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.301921 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.302148 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.302235 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.302456 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.302550 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.302780 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.302868 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.303092 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.303187 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.303396 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.303491 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.303702 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.303820 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.304034 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.304121 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.304376 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.304465 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.304682 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.304768 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.305001 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.305087 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.305327 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.305413 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.305631 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.305724 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.306174 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.306281 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.306373 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.306452 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.306529 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.306676 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.306822 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.306993 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.307124 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.307310 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.307430 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.307634 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.307721 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.307965 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.308055 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.308271 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.308357 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.308582 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.308725 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.308888 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.308985 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.309195 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.309282 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.309499 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.309585 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.309806 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.309901 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.310109 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.310194 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.310410 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.310503 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.310710 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.310795 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.311033 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.311126 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.311338 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.311432 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.311653 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.311737 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.311985 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.312073 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.312294 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.312390 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.312600 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.312686 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.312905 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.312990 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.313226 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.313319 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.313539 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.313624 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.313851 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.313936 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.314166 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.314252 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.315084 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.315191 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.315463 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.315651 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.315827 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.316017 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.316105 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.316341 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.316650 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.316737 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.316967 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.317055 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.317278 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.317363 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.317596 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.317682 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.317945 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.318052 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.318264 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.318364 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.318570 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.318674 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.318997 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.319092 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.319312 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.319491 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.319582 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.319817 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.320024 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.320118 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.320332 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.320597 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.320689 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.320783 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.320964 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.321053 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.321319 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.321530 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.321622 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.321828 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.321918 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.322210 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.322308 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.322520 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.322614 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.322829 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.323018 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.323235 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.323391 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.323766 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.323914 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.323995 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.324073 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.324150 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.324228 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.324429 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.324518 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.324738 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.324823 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.325052 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.325140 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.325409 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.325497 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.325727 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.325812 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.326033 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.326132 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.326338 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.326423 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.326648 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.326735 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.326958 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.327123 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.327270 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.327357 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.327584 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.327671 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.327923 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.328026 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.328240 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.328325 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.328547 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.328631 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.328856 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.328987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.329168 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.329261 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.329482 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.329690 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.329807 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.330075 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.330800 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.330915 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.331240 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.331392 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.331564 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.331721 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.331903 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.332066 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.332219 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.332388 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.332544 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.332848 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.332941 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.333150 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.333237 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.333459 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.333555 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.333766 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.333852 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.334068 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.334155 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.334384 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.334471 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.334692 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.334785 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.334996 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.335082 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.335310 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.335397 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.335616 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.335709 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.335982 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.336169 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.336294 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.336544 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.336646 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.336872 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.336971 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.337207 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.337304 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.337597 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.337696 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.337898 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.337987 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.338209 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.338299 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.338662 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.338767 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.338979 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.339049 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.339254 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.339352 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.339579 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.339683 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.339951 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.340181 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.340277 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.340356 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.340556 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.340746 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.340954 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.341063 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.341274 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.341356 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.341567 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.341759 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.341845 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.342153 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.342253 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.342341 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.342503 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.342584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.342798 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.342980 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.343079 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.343220 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.343308 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.343524 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.343625 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.343852 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.343951 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.344158 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.344243 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.344461 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.344561 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.344766 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.344853 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.345069 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.345155 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.345374 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.345470 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.345714 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.345844 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.346019 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.346266 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.346356 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.346691 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.346809 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.347004 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.347117 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.347312 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.347413 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.347628 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.347715 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.347962 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.348050 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.348274 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.348375 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.348581 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.348668 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.348895 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.348988 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.349202 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.349302 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.349512 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.349600 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.349841 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.349953 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.350176 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.350276 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.350524 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.350612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.350837 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.350924 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.351237 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.351377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.351550 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.351714 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.351900 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.352137 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.352234 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.352475 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.352561 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.352807 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.352895 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.353116 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.353211 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.353421 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.353681 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.353768 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.354041 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.354137 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.354368 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.354459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.354699 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.354785 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.355049 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.355144 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.355355 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.355442 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.355665 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.355753 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.356001 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.356102 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.356328 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.356446 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.356642 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.356798 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.356953 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.357151 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.357265 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.357495 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.357581 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.357835 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.357997 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.358166 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.358254 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.358476 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.358562 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.358786 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.358883 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.359096 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.359184 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.359404 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.359495 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.359714 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.359898 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.360049 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.360223 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.360358 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.360538 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.360672 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.360856 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.360985 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.361164 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.362295 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.362409 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.362409 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.362569 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.362647 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.362730 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.362808 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.362885 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.362970 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.363058 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.363169 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.363286 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.363473 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.363599 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.363925 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.364030 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.364240 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.364330 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.364557 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.364652 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.364876 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.364962 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.365182 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.365269 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.365489 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.365582 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.365808 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.365915 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.366119 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.366233 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.366436 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.366538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.366742 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.366863 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.367069 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.367177 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.367405 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.367541 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.367731 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.367832 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.368079 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.368168 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.368384 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.368478 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.368688 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.368778 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.368987 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.369080 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.369292 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.369417 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.369607 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.369695 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.369919 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.370014 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.370220 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.370353 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.370519 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.370607 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.370824 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.370920 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.371125 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.371211 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.371424 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.371510 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.371723 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.371857 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.372049 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.372136 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.372375 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.372490 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373047 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373154 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373231 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373309 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373387 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373463 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373572 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373685 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373871 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.373990 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.374170 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.374300 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.374510 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.374599 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.374854 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.374941 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.375185 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.375278 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.375490 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.375578 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.375815 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.375906 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.376127 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.376265 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.376439 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.376645 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.376733 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.377522 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.377629 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.377856 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.377946 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.378174 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.378260 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.378481 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.378575 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.378816 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.378906 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.379151 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.379239 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.379469 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.379556 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.379809 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.379958 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.380213 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.380307 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.380629 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.380755 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.380989 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.381084 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.381346 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.381440 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.381685 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.381787 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.382006 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.382105 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.382365 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.382451 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.382676 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.382771 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.382984 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.383077 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.383313 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.383400 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.383637 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.383731 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.383965 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.384052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.384291 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.384386 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.384601 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.384688 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.384919 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.385014 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.385234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.385321 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.385545 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.385634 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.385872 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.385962 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.386180 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.386273 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.386490 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.386624 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.386798 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.386885 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.387108 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.387206 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.387417 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.387503 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.387731 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.387851 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.388067 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.388236 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.388377 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.388463 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.388690 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.388775 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.389000 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.389100 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.389320 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.389407 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.389634 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.389720 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.389945 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.390031 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.390261 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.390346 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.390580 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.390666 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.390915 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.391002 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.391226 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.391312 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.391539 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.391632 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.391898 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.391988 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.392213 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.392301 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.392600 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.393214 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.393399 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.393638 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:55:41.393817 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.394134 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.394473 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.394793 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.395109 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.395421 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:55:41.395666 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:55:41.549091 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO dbcounter [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Registered counter for database nova_api Aug 05 19:55:41.551171 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO dbcounter [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Registered counter for database nova_api Aug 05 19:55:41.571229 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_db.sqlalchemy.engines [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:55:41.573100 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_db.sqlalchemy.engines [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:55:41.578085 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writer thread running {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:55:41.579598 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writer thread running {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:55:41.636678 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.context [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e(cell1) {{(pid=103673) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 19:55:41.636862 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.context [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e(cell1) {{(pid=103672) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 19:55:41.640503 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_concurrency.lockutils [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:41.640678 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:41.640973 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_concurrency.lockutils [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:41.641174 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:41.642537 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_concurrency.lockutils [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:41.642736 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:41.643336 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_concurrency.lockutils [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:41.643528 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:55:41.643773 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_concurrency.lockutils [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:41.643957 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:55:41.645876 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_concurrency.lockutils [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:41.645994 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:55:41.647908 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO dbcounter [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Registered counter for database nova_cell0 Aug 05 19:55:41.648020 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO dbcounter [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Registered counter for database nova_cell0 Aug 05 19:55:41.653461 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO dbcounter [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Registered counter for database nova_cell1 Aug 05 19:55:41.653594 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO dbcounter [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Registered counter for database nova_cell1 Aug 05 19:55:41.661965 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_db.sqlalchemy.engines [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:55:41.663578 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_db.sqlalchemy.engines [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:55:41.665683 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_db.sqlalchemy.engines [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:55:41.667144 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_db.sqlalchemy.engines [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:55:41.669248 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writer thread running {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:55:41.671361 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writer thread running {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:55:41.675661 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writer thread running {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:55:41.677882 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writer thread running {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:55:41.819208 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO dbcounter [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Registered counter for database nova_cell0 Aug 05 19:55:41.820367 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO dbcounter [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Registered counter for database nova_cell0 Aug 05 19:55:41.828914 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG oslo_db.sqlalchemy.engines [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:55:41.834439 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writer thread running {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:55:41.835305 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_db.sqlalchemy.engines [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:55:41.843761 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writer thread running {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:55:42.188513 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: WARNING keystonemiddleware.auth_token [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:55:42.196605 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: WARNING keystonemiddleware.auth_token [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:55:42.270849 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: WARNING keystonemiddleware.auth_token [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:55:42.278328 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: WARNING keystonemiddleware.auth_token [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:55:42.546232 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: WARNING keystonemiddleware.auth_token [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:55:42.556678 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: WARNING keystonemiddleware.auth_token [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:55:42.562060 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2579219c0 pid: 103672 (default app) Aug 05 19:55:42.564310 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:42.565620 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] 10.222.0.95 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001999 Aug 05 19:55:42.566026 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 1/1] 10.222.0.95 () {50 vars in 788 bytes} [Fri Aug 5 19:55:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:42.758427 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: WARNING keystonemiddleware.auth_token [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:55:42.770314 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: WARNING keystonemiddleware.auth_token [None req-e37874fb-6b73-4c68-8e9b-8c01d7b65d05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:55:42.775621 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2579219c0 pid: 103673 (default app) Aug 05 19:56:59.587179 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:59.588263 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 05 19:56:59.588652 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 2/2] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:56:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:59.601728 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writing DB stats nova_api:SELECT=3 {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:59.603138 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writing DB stats nova_cell0:SELECT=3 {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:59.604149 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writing DB stats nova_cell1:SELECT=3 {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:59.605633 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:00.462969 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-377c2255-7f5f-4a4e-8d68-2eef861012f3 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:00.495090 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-377c2255-7f5f-4a4e-8d68-2eef861012f3 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.898477 Aug 05 19:57:00.495901 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 1/3] 10.222.0.95 () {60 vars in 1292 bytes} [Fri Aug 5 19:56:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:02.731586 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:02.732647 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-297d16ec-6208-47b3-9b0b-c73d18f5e09f None None] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Aug 05 19:57:02.733215 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 3/4] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:03.205059 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-cfe8c8b8-d28c-4f7a-953a-611b26346b0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:03.226142 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:57:03.226142 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: warnings.warn(msg) Aug 05 19:57:03.257546 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-cfe8c8b8-d28c-4f7a-953a-611b26346b0a admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.517654 Aug 05 19:57:03.258354 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 2/5] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 19:57:03.273240 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_api:SELECT=3 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:03.274506 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_cell0:SELECT=3 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:03.275643 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_cell1:SELECT=3 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:03.276558 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:03.491545 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-e8ba97e1-ceac-4a11-a9b3-25252085429f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:03.496615 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:57:03.496615 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: warnings.warn(msg) Aug 05 19:57:03.576222 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-e8ba97e1-ceac-4a11-a9b3-25252085429f admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.308609 Aug 05 19:57:03.584226 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 4/6] 10.222.0.95 () {64 vars in 1336 bytes} [Fri Aug 5 19:57:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:05.866513 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-cfe8c8b8-d28c-4f7a-953a-611b26346b0a admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:05.867529 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-cfe8c8b8-d28c-4f7a-953a-611b26346b0a admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 05 19:57:05.868161 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 3/7] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:06.555049 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-e5cc2587-a727-49fd-a41c-44772b448769 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:06.583674 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:57:06.583674 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: warnings.warn(msg) Aug 05 19:57:06.607071 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-e5cc2587-a727-49fd-a41c-44772b448769 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.732654 Aug 05 19:57:06.608059 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 5/8] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:57:06.620310 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-d6a65cb0-bba2-48d6-bb87-9285bbed3750 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:06.624045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:57:06.624045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: warnings.warn(msg) Aug 05 19:57:06.661258 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-d6a65cb0-bba2-48d6-bb87-9285bbed3750 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044901 Aug 05 19:57:06.662086 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 4/9] 10.222.0.95 () {64 vars in 1336 bytes} [Fri Aug 5 19:57:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:57:08.985296 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-e5cc2587-a727-49fd-a41c-44772b448769 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:08.986873 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-e5cc2587-a727-49fd-a41c-44772b448769 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 05 19:57:08.994451 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 6/10] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:08 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:09.379593 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-fddb71ca-3a7b-4fe5-96f9-631a57af90f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "swap": 0, "id": "d2"}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:09.400170 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-fddb71ca-3a7b-4fe5-96f9-631a57af90f2 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.406780 Aug 05 19:57:09.400723 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 5/11] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:57:09.414141 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-b31ad4c1-cf12-4093-b451-c15fc6584e49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:09.439298 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-b31ad4c1-cf12-4093-b451-c15fc6584e49 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028739 Aug 05 19:57:09.440207 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 7/12] 10.222.0.95 () {64 vars in 1336 bytes} [Fri Aug 5 19:57:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:11.723763 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-fddb71ca-3a7b-4fe5-96f9-631a57af90f2 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:11.725519 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-fddb71ca-3a7b-4fe5-96f9-631a57af90f2 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 05 19:57:11.725519 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 6/13] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:12.183051 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-bdc7024e-f7ea-4db5-91da-55cf09fe0a77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:12.208438 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-bdc7024e-f7ea-4db5-91da-55cf09fe0a77 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473874 Aug 05 19:57:12.209224 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 8/14] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:57:12.223451 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-7c880495-bbf0-4ac3-a292-15051e66667a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:12.259513 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-7c880495-bbf0-4ac3-a292-15051e66667a admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039675 Aug 05 19:57:12.266624 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 7/15] 10.222.0.95 () {64 vars in 1336 bytes} [Fri Aug 5 19:57:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:14.536018 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-bdc7024e-f7ea-4db5-91da-55cf09fe0a77 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:14.537015 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-bdc7024e-f7ea-4db5-91da-55cf09fe0a77 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 05 19:57:14.537401 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 9/16] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:14.982526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-a5d43788-cdee-44fc-820f-74cf9a4a0fad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "id": "d4"}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:15.001458 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-a5d43788-cdee-44fc-820f-74cf9a4a0fad admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457952 Aug 05 19:57:15.002226 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 8/17] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:57:15.014653 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-da6335e1-32be-49cf-9bd0-076224d43b03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:15.038358 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-da6335e1-32be-49cf-9bd0-076224d43b03 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028043 Aug 05 19:57:15.038966 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 10/18] 10.222.0.95 () {64 vars in 1336 bytes} [Fri Aug 5 19:57:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:17.506926 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-a5d43788-cdee-44fc-820f-74cf9a4a0fad admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:17.508274 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-a5d43788-cdee-44fc-820f-74cf9a4a0fad admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001923 Aug 05 19:57:17.509087 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 9/19] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:17.936502 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-e94fc39f-53a2-4df3-a93e-1cf6da7dc2ef admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:17.961268 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-e94fc39f-53a2-4df3-a93e-1cf6da7dc2ef admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.445723 Aug 05 19:57:17.961779 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 11/20] 10.222.0.95 () {60 vars in 1292 bytes} [Fri Aug 5 19:57:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:20.274646 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-a5d43788-cdee-44fc-820f-74cf9a4a0fad admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:20.275980 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-a5d43788-cdee-44fc-820f-74cf9a4a0fad admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001871 Aug 05 19:57:20.276456 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 10/21] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:20.716554 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-2163871f-c9ac-47f2-ac7a-374a19eaca07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "1", "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:20.736369 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-2163871f-c9ac-47f2-ac7a-374a19eaca07 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.453084 Aug 05 19:57:20.737020 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 12/22] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 19:57:20.750119 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-3df83ab9-e190-4e61-ac93-902755a67f38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:20.777052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-3df83ab9-e190-4e61-ac93-902755a67f38 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031363 Aug 05 19:57:20.777632 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 11/23] 10.222.0.95 () {64 vars in 1333 bytes} [Fri Aug 5 19:57:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:57:22.999653 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-2163871f-c9ac-47f2-ac7a-374a19eaca07 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:23.000678 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-2163871f-c9ac-47f2-ac7a-374a19eaca07 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 05 19:57:23.001444 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 13/24] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:57:23.421087 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-8137ff57-e115-4fb7-b64d-bf8f1df8a125 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:23.440135 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-8137ff57-e115-4fb7-b64d-bf8f1df8a125 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423366 Aug 05 19:57:23.440777 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 12/25] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:57:23.458542 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-c47340df-0b1a-4d5b-ab25-6e8d20bb2518 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:23.483303 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-c47340df-0b1a-4d5b-ab25-6e8d20bb2518 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033629 Aug 05 19:57:23.483893 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 14/26] 10.222.0.95 () {64 vars in 1333 bytes} [Fri Aug 5 19:57:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:25.853436 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-8137ff57-e115-4fb7-b64d-bf8f1df8a125 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:25.854623 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-8137ff57-e115-4fb7-b64d-bf8f1df8a125 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 05 19:57:25.855177 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 13/27] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:26.282156 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-05b96519-9429-49c2-af2e-982642a0efa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium"}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:26.302661 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-05b96519-9429-49c2-af2e-982642a0efa5 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.441035 Aug 05 19:57:26.303219 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 15/28] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 19:57:26.317127 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-0264ce88-50c5-4480-a7d3-b881232fa322 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:26.343787 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-0264ce88-50c5-4480-a7d3-b881232fa322 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031636 Aug 05 19:57:26.344745 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 14/29] 10.222.0.95 () {64 vars in 1333 bytes} [Fri Aug 5 19:57:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:57:28.697794 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-05b96519-9429-49c2-af2e-982642a0efa5 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:28.698801 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-05b96519-9429-49c2-af2e-982642a0efa5 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 05 19:57:28.699230 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 16/30] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:29.233236 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-6ad42502-2a76-4036-9d9f-b19ce1ecd021 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:29.255728 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-6ad42502-2a76-4036-9d9f-b19ce1ecd021 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.549876 Aug 05 19:57:29.256712 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 15/31] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:57:29.270157 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-218ae7db-36cf-4c2e-a12b-f05c72a98e80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:29.303918 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-218ae7db-36cf-4c2e-a12b-f05c72a98e80 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038273 Aug 05 19:57:29.305369 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 17/32] 10.222.0.95 () {64 vars in 1333 bytes} [Fri Aug 5 19:57:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:31.656611 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-6ad42502-2a76-4036-9d9f-b19ce1ecd021 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:31.657773 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-6ad42502-2a76-4036-9d9f-b19ce1ecd021 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Aug 05 19:57:31.658266 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 16/33] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:32.118778 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-2bd0b685-9646-412b-bcdd-eb8be5de0eee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "5", "name": "m1.xlarge", "ram": 16384, "disk": 160, "vcpus": 8}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:32.140527 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-2bd0b685-9646-412b-bcdd-eb8be5de0eee admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471855 Aug 05 19:57:32.141477 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 18/34] 10.222.0.95 () {64 vars in 1283 bytes} [Fri Aug 5 19:57:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:57:32.155824 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-205fb300-a173-43f6-ba37-450d84403da4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:32.160961 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:32.184031 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-205fb300-a173-43f6-ba37-450d84403da4 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033965 Aug 05 19:57:32.184736 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 17/35] 10.222.0.95 () {64 vars in 1333 bytes} [Fri Aug 5 19:57:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:57:53.041083 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-2bd0b685-9646-412b-bcdd-eb8be5de0eee admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:53.042086 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-2bd0b685-9646-412b-bcdd-eb8be5de0eee admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 05 19:57:53.042483 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 19/36] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:53.433950 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-a7ed3399-23ce-4d2b-b773-9a997510115b admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:53.452366 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-a7ed3399-23ce-4d2b-b773-9a997510115b admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403565 Aug 05 19:57:53.452896 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 18/37] 10.222.0.95 () {60 vars in 1292 bytes} [Fri Aug 5 19:57:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:54.542968 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-2bd0b685-9646-412b-bcdd-eb8be5de0eee admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:54.544048 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-2bd0b685-9646-412b-bcdd-eb8be5de0eee admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 05 19:57:54.544453 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 20/38] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 19:57:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:55.069978 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-69bbe1e1-365a-44af-8e6d-b63c2b0ab5ae admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:55.075682 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.wsgi [None req-69bbe1e1-365a-44af-8e6d-b63c2b0ab5ae admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-69bbe1e1-365a-44af-8e6d-b63c2b0ab5ae admin admin] Request method failure captured: Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Accept: application/json Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Accept-Encoding: gzip, deflate Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Connection: keep-alive Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Content-Length: 0 Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Host: 10.222.0.95 Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Openstack-Api-Version: compute 2.90 Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Openstack-System-Scope: None Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: User-Agent: python-novaclient Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Auth-Token: gAAAAABi7XZCV_pzY1j7i7sA0yFBcxLjkYCPhHR5CPSLRtPAPDvz368zMqUupiI1cCe293-h4gDzgVj-mvMXO5U7stxy-rNS_tN9yjbMZs8NsLC0RnPu-ESdTg16-UNAshHjjkltodUa1tORU5_c1b3QtY8Xswn9iepOC1q4Q-F04pfMb3fCmJc Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Domain-Id: None Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Domain-Name: None Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Identity-Status: Confirmed Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Is-Admin-Project: True Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Domain-Id: default Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Domain-Name: Default Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Name: admin Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Role: admin,member,reader Aug 05 19:57:55.080052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Roles: admin,member,reader Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Tenant: admin Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Tenant-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Tenant-Name: admin Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User: admin Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Domain-Id: default Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Domain-Name: Default Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Id: 72bbdec94ebd4a7ead34c004dcfc40eb Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Name: admin Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: method: > Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: exception: Flavor 42 could not be found. Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: action_args: {'id': '42'} Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:55.081612 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:55.082538 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.084055 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-69bbe1e1-365a-44af-8e6d-b63c2b0ab5ae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:55.085263 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-69bbe1e1-365a-44af-8e6d-b63c2b0ab5ae admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393960 Aug 05 19:57:55.085263 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 19/39] 10.222.0.95 () {60 vars in 1190 bytes} [Fri Aug 5 19:57:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:55.091104 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-c9b36c39-d077-4975-ac10-c9f785e2e1fd admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:55.096141 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:55.115227 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-c9b36c39-d077-4975-ac10-c9f785e2e1fd admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027658 Aug 05 19:57:55.115784 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 21/40] 10.222.0.95 () {60 vars in 1210 bytes} [Fri Aug 5 19:57:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:55.126447 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-626ba290-40e3-4880-90d8-cbd032ec962d admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:55.150710 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-626ba290-40e3-4880-90d8-cbd032ec962d admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028748 Aug 05 19:57:55.151260 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 20/41] 10.222.0.95 () {60 vars in 1210 bytes} [Fri Aug 5 19:57:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:55.161676 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-b43e4398-b8e7-4969-9e3b-cee002a5f08b admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:55.168552 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.wsgi [None req-b43e4398-b8e7-4969-9e3b-cee002a5f08b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-b43e4398-b8e7-4969-9e3b-cee002a5f08b admin admin] Request method failure captured: Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Accept: application/json Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Accept-Encoding: gzip, deflate Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Connection: keep-alive Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Content-Length: 0 Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Host: 10.222.0.95 Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Openstack-Api-Version: compute 2.90 Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Openstack-System-Scope: None Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: User-Agent: python-novaclient Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Auth-Token: gAAAAABi7XZCV_pzY1j7i7sA0yFBcxLjkYCPhHR5CPSLRtPAPDvz368zMqUupiI1cCe293-h4gDzgVj-mvMXO5U7stxy-rNS_tN9yjbMZs8NsLC0RnPu-ESdTg16-UNAshHjjkltodUa1tORU5_c1b3QtY8Xswn9iepOC1q4Q-F04pfMb3fCmJc Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Domain-Id: None Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Domain-Name: None Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Identity-Status: Confirmed Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Is-Admin-Project: True Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Domain-Id: default Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Domain-Name: Default Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Name: admin Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Role: admin,member,reader Aug 05 19:57:55.172234 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Roles: admin,member,reader Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Tenant: admin Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Tenant-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Tenant-Name: admin Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User: admin Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Domain-Id: default Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Domain-Name: Default Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Id: 72bbdec94ebd4a7ead34c004dcfc40eb Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Name: admin Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: method: > Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: exception: Flavor 42 could not be found. Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: action_args: {'id': '42'} Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:55.173762 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:55.174833 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:55.176206 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-b43e4398-b8e7-4969-9e3b-cee002a5f08b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:55.177426 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-b43e4398-b8e7-4969-9e3b-cee002a5f08b admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015788 Aug 05 19:57:55.177426 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 22/42] 10.222.0.95 () {60 vars in 1190 bytes} [Fri Aug 5 19:57:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:56.147613 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-626ba290-40e3-4880-90d8-cbd032ec962d admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:56.148655 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-626ba290-40e3-4880-90d8-cbd032ec962d admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 05 19:57:56.149052 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 21/43] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 19:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:56.697066 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-df94e855-018f-48ad-a2e7-8a1672d54a86 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:56.702870 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.wsgi [None req-df94e855-018f-48ad-a2e7-8a1672d54a86 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-df94e855-018f-48ad-a2e7-8a1672d54a86 admin admin] Request method failure captured: Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Accept: application/json Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Accept-Encoding: gzip, deflate Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Connection: keep-alive Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Content-Length: 0 Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Host: 10.222.0.95 Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Openstack-Api-Version: compute 2.90 Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Openstack-System-Scope: None Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: User-Agent: python-novaclient Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Auth-Token: gAAAAABi7XZEGVckNsvOWXHHe9fHNJKkq_WKD3uZrkFEO4cgp0PYrIgPPIs3lE4NPhchzn_W-vI7NScFwoPro0XXNq3-LhmFxseNW2Rc6I_dwOdamNQzOjwCvRJADdmZHkGOFwAMN4GewoDhTQrF1KVhNuzFSOp4brLkmp2oLujyyBPogVEfd2Y Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Domain-Id: None Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Domain-Name: None Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Identity-Status: Confirmed Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Is-Admin-Project: True Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Domain-Id: default Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Domain-Name: Default Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Name: admin Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Role: admin,member,reader Aug 05 19:57:56.704408 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Roles: admin,member,reader Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Tenant: admin Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Tenant-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Tenant-Name: admin Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User: admin Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Domain-Id: default Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Domain-Name: Default Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Id: 72bbdec94ebd4a7ead34c004dcfc40eb Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Name: admin Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: method: > Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: exception: Flavor 84 could not be found. Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: action_args: {'id': '84'} Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:56.705935 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:56.706860 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.708392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-df94e855-018f-48ad-a2e7-8a1672d54a86 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:56.709788 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-df94e855-018f-48ad-a2e7-8a1672d54a86 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.412595 Aug 05 19:57:56.709788 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 23/44] 10.222.0.95 () {60 vars in 1190 bytes} [Fri Aug 5 19:57:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:56.715662 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-71297e0b-8fa6-4764-a8e7-66575c6bef39 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:56.730925 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-71297e0b-8fa6-4764-a8e7-66575c6bef39 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018864 Aug 05 19:57:56.731448 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 22/45] 10.222.0.95 () {60 vars in 1210 bytes} [Fri Aug 5 19:57:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:56.741523 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-423c6475-fbe2-4184-b80a-b6274959d81c admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:56.756384 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-423c6475-fbe2-4184-b80a-b6274959d81c admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018317 Aug 05 19:57:56.756912 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 24/46] 10.222.0.95 () {60 vars in 1210 bytes} [Fri Aug 5 19:57:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:56.766144 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-1876c989-cdd3-4fb7-8d96-1995cb4b38e7 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:56.771457 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.wsgi [None req-1876c989-cdd3-4fb7-8d96-1995cb4b38e7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-1876c989-cdd3-4fb7-8d96-1995cb4b38e7 admin admin] Request method failure captured: Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Accept: application/json Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Accept-Encoding: gzip, deflate Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Connection: keep-alive Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Content-Length: 0 Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Host: 10.222.0.95 Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Openstack-Api-Version: compute 2.90 Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Openstack-System-Scope: None Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: User-Agent: python-novaclient Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Auth-Token: gAAAAABi7XZEGVckNsvOWXHHe9fHNJKkq_WKD3uZrkFEO4cgp0PYrIgPPIs3lE4NPhchzn_W-vI7NScFwoPro0XXNq3-LhmFxseNW2Rc6I_dwOdamNQzOjwCvRJADdmZHkGOFwAMN4GewoDhTQrF1KVhNuzFSOp4brLkmp2oLujyyBPogVEfd2Y Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Domain-Id: None Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Domain-Name: None Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Identity-Status: Confirmed Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Is-Admin-Project: True Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Domain-Id: default Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Domain-Name: Default Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Name: admin Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Role: admin,member,reader Aug 05 19:57:56.772987 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Roles: admin,member,reader Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Tenant: admin Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Tenant-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Tenant-Name: admin Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User: admin Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Domain-Id: default Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Domain-Name: Default Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Id: 72bbdec94ebd4a7ead34c004dcfc40eb Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Name: admin Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: method: > Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: exception: Flavor 84 could not be found. Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: action_args: {'id': '84'} Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:56.774487 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:56.775303 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:56.776459 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-1876c989-cdd3-4fb7-8d96-1995cb4b38e7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:56.777864 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-1876c989-cdd3-4fb7-8d96-1995cb4b38e7 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011767 Aug 05 19:57:56.777864 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 23/47] 10.222.0.95 () {60 vars in 1190 bytes} [Fri Aug 5 19:57:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 05 19:57:57.760081 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-423c6475-fbe2-4184-b80a-b6274959d81c admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:57.761110 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-423c6475-fbe2-4184-b80a-b6274959d81c admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 05 19:57:57.761531 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 25/48] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 19:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:58.297813 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-dce42fbe-2b95-41d6-b92e-f3229b691c71 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:58.303675 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.wsgi [None req-dce42fbe-2b95-41d6-b92e-f3229b691c71 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-dce42fbe-2b95-41d6-b92e-f3229b691c71 admin admin] Request method failure captured: Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Accept: application/json Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Accept-Encoding: gzip, deflate Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Connection: keep-alive Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Content-Length: 0 Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Host: 10.222.0.95 Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Openstack-Api-Version: compute 2.90 Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Openstack-System-Scope: None Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: User-Agent: python-novaclient Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Auth-Token: gAAAAABi7XZFFQa19HvbAz40MIukjasrm39QNiyx-SJVejCF3dh36X-oHtUcaDusH5OVHKAsACac5WLRdXWYzVUr5SDfAgH8WeoKuX7TvWbId0v85Y00FEZmQ8MHzbBea89hIsUmnHF98GaA3yhrcTjOP9sx8W9yQZerFOQ8q0Dd49Ng6114o9Y Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Domain-Id: None Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Domain-Name: None Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Identity-Status: Confirmed Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Is-Admin-Project: True Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Domain-Id: default Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Domain-Name: Default Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Project-Name: admin Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Role: admin,member,reader Aug 05 19:57:58.305190 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Roles: admin,member,reader Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Tenant: admin Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Tenant-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-Tenant-Name: admin Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User: admin Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Domain-Id: default Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Domain-Name: Default Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Id: 72bbdec94ebd4a7ead34c004dcfc40eb Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: X-User-Name: admin Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: method: > Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: exception: Flavor 451 could not be found. Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: action_args: {'id': '451'} Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:58.307526 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:58.308937 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.311045 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-dce42fbe-2b95-41d6-b92e-f3229b691c71 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:58.313886 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-dce42fbe-2b95-41d6-b92e-f3229b691c71 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.400723 Aug 05 19:57:58.313886 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 24/49] 10.222.0.95 () {60 vars in 1193 bytes} [Fri Aug 5 19:57:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 05 19:57:58.317483 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-174aed38-6083-4c33-8e77-fb9177f77a85 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:58.332517 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-174aed38-6083-4c33-8e77-fb9177f77a85 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019228 Aug 05 19:57:58.333020 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 26/50] 10.222.0.95 () {60 vars in 1210 bytes} [Fri Aug 5 19:57:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:57:58.342805 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:58.357977 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018575 Aug 05 19:57:58.358513 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 25/51] 10.222.0.95 () {60 vars in 1210 bytes} [Fri Aug 5 19:57:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:58.367741 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-4c7348a7-f9ad-4e7b-8ee8-43a7dadb740d admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:58.372989 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.wsgi [None req-4c7348a7-f9ad-4e7b-8ee8-43a7dadb740d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-4c7348a7-f9ad-4e7b-8ee8-43a7dadb740d admin admin] Request method failure captured: Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Accept: application/json Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Accept-Encoding: gzip, deflate Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Connection: keep-alive Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Content-Length: 0 Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Host: 10.222.0.95 Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Openstack-Api-Version: compute 2.90 Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Openstack-System-Scope: None Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: User-Agent: python-novaclient Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Auth-Token: gAAAAABi7XZFFQa19HvbAz40MIukjasrm39QNiyx-SJVejCF3dh36X-oHtUcaDusH5OVHKAsACac5WLRdXWYzVUr5SDfAgH8WeoKuX7TvWbId0v85Y00FEZmQ8MHzbBea89hIsUmnHF98GaA3yhrcTjOP9sx8W9yQZerFOQ8q0Dd49Ng6114o9Y Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Domain-Id: None Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Domain-Name: None Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Identity-Status: Confirmed Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Is-Admin-Project: True Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Domain-Id: default Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Domain-Name: Default Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Project-Name: admin Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Role: admin,member,reader Aug 05 19:57:58.374584 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Roles: admin,member,reader Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/77f7a859119a4ba5a9748b0c556b058a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Tenant: admin Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Tenant-Id: 77f7a859119a4ba5a9748b0c556b058a Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-Tenant-Name: admin Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User: admin Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Domain-Id: default Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Domain-Name: Default Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Id: 72bbdec94ebd4a7ead34c004dcfc40eb Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: X-User-Name: admin Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: method: > Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: exception: Flavor 451 could not be found. Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: action_args: {'id': '451'} Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:57:58.376335 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:58.377377 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: ERROR nova.api.openstack.wsgi Aug 05 19:57:58.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-4c7348a7-f9ad-4e7b-8ee8-43a7dadb740d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:57:58.379756 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-4c7348a7-f9ad-4e7b-8ee8-43a7dadb740d admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011762 Aug 05 19:57:58.379756 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 27/52] 10.222.0.95 () {60 vars in 1193 bytes} [Fri Aug 5 19:57:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:57:59.344659 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:59.345665 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 05 19:57:59.346058 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 26/53] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 19:57:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:59.869407 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-a5c0c1d8-e52a-4a96-a2e6-a61605bcb750 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:57:59.890188 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-a5c0c1d8-e52a-4a96-a2e6-a61605bcb750 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406887 Aug 05 19:57:59.890720 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 28/54] 10.222.0.95 () {64 vars in 1235 bytes} [Fri Aug 5 19:57:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:58:00.989348 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:00.990352 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 05 19:58:00.990742 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 27/55] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 19:58:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:01.519894 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-87332a78-9132-459b-8ec5-9184274975ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:01.538299 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-87332a78-9132-459b-8ec5-9184274975ca admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.409753 Aug 05 19:58:01.538836 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 29/56] 10.222.0.95 () {64 vars in 1235 bytes} [Fri Aug 5 19:58:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:58:02.530111 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:02.531119 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Aug 05 19:58:02.531509 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 28/57] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 19:58:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:03.065432 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-a3a98609-f26d-47f7-bc39-093802a62ecf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:03.084671 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-a3a98609-f26d-47f7-bc39-093802a62ecf admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407025 Aug 05 19:58:03.085209 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 30/58] 10.222.0.95 () {64 vars in 1235 bytes} [Fri Aug 5 19:58:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:58:04.061988 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:04.062994 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 05 19:58:04.063409 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 29/59] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 19:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:04.597622 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-ca3cf317-6963-4c86-b06d-9f6a69a5ba3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:58:04.616457 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-ca3cf317-6963-4c86-b06d-9f6a69a5ba3c admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.413661 Aug 05 19:58:04.616999 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 31/60] 10.222.0.95 () {64 vars in 1235 bytes} [Fri Aug 5 19:58:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:58:05.599388 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:05.600423 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 05 19:58:05.600820 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 30/61] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 19:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:06.137331 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-4639fd8a-85e8-43e9-8236-37d6090583d0 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:06.159152 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-4639fd8a-85e8-43e9-8236-37d6090583d0 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412450 Aug 05 19:58:06.159662 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 32/62] 10.222.0.95 () {60 vars in 1202 bytes} [Fri Aug 5 19:58:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:58:58.284255 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:58.285272 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-2d50360c-a2b3-49fd-a73c-e6cc90f1e396 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 05 19:58:58.285665 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 31/63] 10.222.0.95 () {54 vars in 931 bytes} [Fri Aug 5 19:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:58:58.297198 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:58.684617 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-ae2d16a7-d2fd-4298-b275-75088a33b0c9 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:58.705703 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-ae2d16a7-d2fd-4298-b275-75088a33b0c9 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.413844 Aug 05 19:58:58.706235 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 33/64] 10.222.0.95 () {60 vars in 1292 bytes} [Fri Aug 5 19:58:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:58:58.728417 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG dbcounter [-] [103673] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:58:58.733130 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-068bf563-2e6e-4648-b027-97fe1824ac82 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:58.741745 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-068bf563-2e6e-4648-b027-97fe1824ac82 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014871 Aug 05 19:58:58.742286 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 32/65] 10.222.0.95 () {60 vars in 1283 bytes} [Fri Aug 5 19:58:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:58.755396 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-e8a8713c-0a46-4b75-af56-fb6675d32e25 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:58.766359 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-e8a8713c-0a46-4b75-af56-fb6675d32e25 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014812 Aug 05 19:58:58.766918 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 34/66] 10.222.0.95 () {60 vars in 1286 bytes} [Fri Aug 5 19:58:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:58.782513 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:58.791054 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013489 Aug 05 19:58:58.791579 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 33/67] 10.222.0.95 () {60 vars in 1286 bytes} [Fri Aug 5 19:58:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:58:58.804024 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-0c0a11ea-f429-4a1e-a8d6-7f775d2d8646 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:58:58.813341 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-0c0a11ea-f429-4a1e-a8d6-7f775d2d8646 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012610 Aug 05 19:58:58.814151 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 35/68] 10.222.0.95 () {60 vars in 1283 bytes} [Fri Aug 5 19:58:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:02:06.351978 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:06.353065 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Aug 05 20:02:06.353480 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 34/69] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 20:02:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:06.505016 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_api:SELECT=6 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:06.663666 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-2f2b7562-52b7-40d2-8462-ca0119d0111b admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:06.666392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:02:06.666392 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: warnings.warn(msg) Aug 05 20:02:06.667496 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-2f2b7562-52b7-40d2-8462-ca0119d0111b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:06.668003 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-2f2b7562-52b7-40d2-8462-ca0119d0111b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:06.668429 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-2f2b7562-52b7-40d2-8462-ca0119d0111b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:06.669134 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-2f2b7562-52b7-40d2-8462-ca0119d0111b admin admin] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:06.669575 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-2f2b7562-52b7-40d2-8462-ca0119d0111b admin admin] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:06.669984 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-2f2b7562-52b7-40d2-8462-ca0119d0111b admin admin] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:06.704466 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-2f2b7562-52b7-40d2-8462-ca0119d0111b admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.206113 Aug 05 20:02:06.705026 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 36/70] 10.222.0.95 () {60 vars in 1193 bytes} [Fri Aug 5 20:02:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:02:07.538795 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:07.539841 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Aug 05 20:02:07.540489 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 35/71] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 20:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:07.729847 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-16d135ab-4d8e-4b0b-872a-9471d41c4af8 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:07.732251 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:02:07.732251 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: warnings.warn(msg) Aug 05 20:02:07.733391 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-16d135ab-4d8e-4b0b-872a-9471d41c4af8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:07.733866 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-16d135ab-4d8e-4b0b-872a-9471d41c4af8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:07.734274 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-16d135ab-4d8e-4b0b-872a-9471d41c4af8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:07.734975 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-16d135ab-4d8e-4b0b-872a-9471d41c4af8 admin admin] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:07.735413 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-16d135ab-4d8e-4b0b-872a-9471d41c4af8 admin admin] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:07.735839 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-16d135ab-4d8e-4b0b-872a-9471d41c4af8 admin admin] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:07.755114 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-16d135ab-4d8e-4b0b-872a-9471d41c4af8 admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077078 Aug 05 20:02:07.755653 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 37/72] 10.222.0.95 () {60 vars in 1193 bytes} [Fri Aug 5 20:02:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:02:19.000406 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:19.001404 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 05 20:02:19.001952 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 36/73] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 20:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:19.154970 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_cell0:SELECT=4 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:19.156097 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_cell1:SELECT=4 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:19.156951 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG dbcounter [-] [103672] Writing DB stats nova_api:SELECT=8 {{(pid=103672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:19.214861 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-b1de72bf-7e5b-44bc-a309-5bacaf0998b2 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:19.218013 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:02:19.218013 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: warnings.warn(msg) Aug 05 20:02:19.219111 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-b1de72bf-7e5b-44bc-a309-5bacaf0998b2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:19.219585 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-b1de72bf-7e5b-44bc-a309-5bacaf0998b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:19.220030 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-b1de72bf-7e5b-44bc-a309-5bacaf0998b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:19.220741 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-b1de72bf-7e5b-44bc-a309-5bacaf0998b2 admin admin] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:19.221189 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-b1de72bf-7e5b-44bc-a309-5bacaf0998b2 admin admin] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:19.221600 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-b1de72bf-7e5b-44bc-a309-5bacaf0998b2 admin admin] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:19.246630 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-b1de72bf-7e5b-44bc-a309-5bacaf0998b2 admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.100324 Aug 05 20:02:19.247182 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 38/74] 10.222.0.95 () {60 vars in 1193 bytes} [Fri Aug 5 20:02:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:02:20.157807 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: DEBUG nova.api.openstack.wsgi [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] Calling method '>' {{(pid=103673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:20.158826 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: INFO nova.api.openstack.requestlog [None req-5713754b-e403-484f-b6f6-787195990177 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 05 20:02:20.159197 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: [pid: 103673|app: 0|req: 37/75] 10.222.0.95 () {56 vars in 1074 bytes} [Fri Aug 5 20:02:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:20.361999 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG nova.api.openstack.wsgi [None req-ccf65e47-20da-439d-975e-ea127f9d3346 admin admin] Calling method '>' {{(pid=103672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:20.364387 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:02:20.364387 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: warnings.warn(msg) Aug 05 20:02:20.365530 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-ccf65e47-20da-439d-975e-ea127f9d3346 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:20.365946 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-ccf65e47-20da-439d-975e-ea127f9d3346 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:20.366365 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-ccf65e47-20da-439d-975e-ea127f9d3346 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:20.367073 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-ccf65e47-20da-439d-975e-ea127f9d3346 admin admin] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:20.367514 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-ccf65e47-20da-439d-975e-ea127f9d3346 admin admin] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:20.368102 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: DEBUG oslo_concurrency.lockutils [None req-ccf65e47-20da-439d-975e-ea127f9d3346 admin admin] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:20.390189 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: INFO nova.api.openstack.requestlog [None req-ccf65e47-20da-439d-975e-ea127f9d3346 admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080449 Aug 05 20:02:20.390730 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: [pid: 103672|app: 0|req: 39/76] 10.222.0.95 () {60 vars in 1193 bytes} [Fri Aug 5 20:02:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:03:20.832817 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: Fri Aug 5 20:03:20 2022 - graceful shutdown triggered... Aug 05 20:03:20.833385 dv-cinder-852211-3-iscsi devstack@n-api.service[103672]: Gracefully killing worker 1 (pid: 103672)... Aug 05 20:03:20.833772 dv-cinder-852211-3-iscsi devstack@n-api.service[103673]: Gracefully killing worker 2 (pid: 103673)... Aug 05 20:03:20.834375 dv-cinder-852211-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 20:03:21.834610 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: worker 1 buried after 1 seconds Aug 05 20:03:21.834610 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: worker 2 buried after 1 seconds Aug 05 20:03:21.834610 dv-cinder-852211-3-iscsi devstack@n-api.service[103671]: goodbye to uWSGI. Aug 05 20:03:21.836544 dv-cinder-852211-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 20:03:21.837105 dv-cinder-852211-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 20:03:21.840087 dv-cinder-852211-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 20:03:21.852563 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 20:03:21.855149 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 20:03:21 2022] *** Aug 05 20:03:21.855149 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 20:03:21.855149 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 20:03:21.855149 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: nodename: dv-cinder-852211-3-iscsi Aug 05 20:03:21.855149 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: machine: x86_64 Aug 05 20:03:21.855149 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: clock source: unix Aug 05 20:03:21.855149 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: pcre jit disabled Aug 05 20:03:21.855149 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: detected number of CPU cores: 4 Aug 05 20:03:21.855665 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: current working directory: / Aug 05 20:03:21.855665 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: detected binary path: /usr/bin/uwsgi-core Aug 05 20:03:21.855665 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: your processes number limit is 47680 Aug 05 20:03:21.855665 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: your memory page size is 4096 bytes Aug 05 20:03:21.855665 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: detected max file descriptor number: 2048 Aug 05 20:03:21.855665 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: lock engine: pthread robust mutexes Aug 05 20:03:21.855665 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: thunder lock: enabled Aug 05 20:03:21.855665 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 20:03:21.856169 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 20:03:21.913681 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: Python main interpreter initialized at 0x5555d6c5a9c0 Aug 05 20:03:21.913681 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: python threads support enabled Aug 05 20:03:21.913681 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: your server socket listen backlog is limited to 100 connections Aug 05 20:03:21.913681 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: your mercy for graceful operations on workers is 90 seconds Aug 05 20:03:21.914121 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 20:03:21.914121 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: *** Operational MODE: preforking *** Aug 05 20:03:21.914387 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: *** uWSGI is running in multiple interpreter mode *** Aug 05 20:03:21.914387 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: spawned uWSGI master process (pid: 118156) Aug 05 20:03:21.914594 dv-cinder-852211-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 20:03:21.916603 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: spawned uWSGI worker 1 (pid: 118174, cores: 1) Aug 05 20:03:21.916603 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: spawned uWSGI worker 2 (pid: 118175, cores: 1) Aug 05 20:03:21.916603 dv-cinder-852211-3-iscsi devstack@n-api.service[118156]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 20:03:22.594016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 20:03:22.618044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 20:03:23.764582 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:03:23.764582 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: from cryptography.utils import int_from_bytes Aug 05 20:03:23.765214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:03:23.765214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: from cryptography.utils import int_from_bytes Aug 05 20:03:23.793834 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:03:23.793834 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: from cryptography.utils import int_from_bytes Aug 05 20:03:23.794392 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:03:23.794392 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: from cryptography.utils import int_from_bytes Aug 05 20:03:26.092239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:03:26.092810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:03:26.093038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:03:26.093373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:03:26.093630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:03:26.094016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.094343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.094665 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.094985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.095394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.095691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.096035 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.096359 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.096687 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.096951 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.097269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.097592 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-3-iscsi {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.097914 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.098220 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.098530 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.098853 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.099188 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.100154 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.100154 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.100338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.102100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.102100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.102100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.102100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.102100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.102518 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.102608 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.107486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.107486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.107486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.107486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-3-iscsi {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.107486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.107486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.107486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.107486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108814 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108814 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.108814 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.109042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.109373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.109545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.109770 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.110016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.110316 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.110629 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.111678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.112032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.112189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.112337 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.113872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.113872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.113872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.113872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.114584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.114584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.114584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.115071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.115071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.115369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.115858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.116030 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.116343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.116649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.116969 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.117374 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.95 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.117624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.95 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.117928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.118266 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.118585 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.118892 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.119210 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.119528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.119970 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.120144 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.120449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.120766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.121097 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.121400 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.121649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.121948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.122251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.122569 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.122898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.123214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.123520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.124717 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.124934 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.125246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.125554 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.125869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.126186 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.126471 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.127829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.127829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.128440 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.128627 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.128944 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.129259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.129568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.129878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.130307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.130488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.130799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.131118 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.131441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.131746 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.132075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.132408 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.132728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.133036 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.133354 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.133656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.133962 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.134278 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.134587 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.134891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.135044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:03:26.135505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.135663 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:03:26.135880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.136126 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:03:26.136313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.136313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.136613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:03:26.136613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:03:26.136904 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.136904 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.137177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.137333 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.137485 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.137645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.137810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.137998 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.138161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.138317 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.138478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.138663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.138809 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.138962 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.139108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.139260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.139419 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.139565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.139718 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.139909 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.140066 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.140227 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.140373 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.140518 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.140661 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-3-iscsi {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.140804 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.140961 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.141120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.141266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.141410 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.141555 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.141709 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.141861 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.142020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.142249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.142484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.142703 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.143030 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.143192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.143349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.143349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.143625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.143877 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.144047 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.144211 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.144417 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.144567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.144721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.144873 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.145026 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.145187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.145334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.145479 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.145631 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.145785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.146021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.146265 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.146431 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.146586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.146732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.146884 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.147043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.147206 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.147434 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-3-iscsi {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.147585 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.147730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.147913 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.148110 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.148280 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.148436 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.148581 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.148726 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.148881 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.149033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.149185 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.149337 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.149501 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.149656 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.149801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.149946 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.150099 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.150254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.150407 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.150562 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.150716 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.150869 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.151014 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.151167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.151319 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.151477 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.151632 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.151848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.152016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.152174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.152326 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.152481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.152635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.152789 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.152934 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.153090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.153262 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.154899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.155631 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.155863 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.156284 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.156498 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.156717 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.156921 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.157122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.157279 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.157432 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.157607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.157799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.157967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.158313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.158471 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.158621 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.158777 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.158894 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.159015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.159186 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.159372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.159526 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.159716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.159923 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.160049 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.160190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.160306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.160458 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.160587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.160718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.160849 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.160969 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.161098 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.161239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.161372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.161491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.161610 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.161722 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.161841 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.161967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.162097 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.162239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.162380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.162512 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.162512 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.162807 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.162961 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.163114 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.95 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.163266 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.163410 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.95 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.163846 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.164001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.164146 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.164300 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.164459 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.164604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.164757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.164902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.165052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.165198 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.165349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.165494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.165651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.165651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.165651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.165651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.166209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.166523 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.166679 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.166837 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.166982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.167133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.167286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.167441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.167608 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.167791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.168296 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.168469 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.168607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.168799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.168971 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.169164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.169339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.169699 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.169860 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.169996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.170120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.170203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.170275 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.170371 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.170457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.170537 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.170678 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.170866 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.170956 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.171048 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.171121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.171208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.171336 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.171481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.171568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.171648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.171732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.171873 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.171964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.172037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.172114 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.172199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.172284 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.172377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.172510 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.172633 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.172722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.172806 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.172897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.172995 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.173088 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.173172 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.173263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.173348 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.174187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.174353 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.174436 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.174509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.174589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.174661 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.174739 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.174810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.174895 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.174981 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.175072 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.175151 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.175229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.175299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.175377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.175456 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.175527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.175597 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.175674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.175746 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.175844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.175936 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.176035 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.176122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.176200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.176283 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.176375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.176467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.176552 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.176635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.176730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.176819 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.176911 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.177004 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.177092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.177183 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.177268 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.177391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.177487 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.177728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.177811 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.178033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.178177 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.178366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.178516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.178668 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.178812 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.178934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.179054 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.179316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.179468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.179592 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.179705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.179884 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.180006 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.180207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.180370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.180518 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:03:26.180658 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.180833 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.181003 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.181148 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.181281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.181460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.181593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.181785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.181909 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.182117 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.182263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.182436 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.182572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.182741 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.182890 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.183038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.183178 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.183366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.183510 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.183695 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.183861 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.184014 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.184148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.184325 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.184470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.184646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.184797 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.184957 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.185103 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.185269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.185406 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.185579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.185730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.185887 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.186024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.186198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.186336 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.186509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.186660 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.186824 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.186960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.187132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.187268 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.187443 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.187589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.187749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.187958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.188092 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.188227 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.188416 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.188552 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.188692 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.188831 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.188973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.189960 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.190111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.190243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.190382 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.190520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.190658 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.190796 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.190937 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.191075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.191214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.191345 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.191534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.191670 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.191908 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.192057 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.192261 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.192403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.193098 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.193215 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.193335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.193468 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.193601 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.193714 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.193834 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.194013 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.194186 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.194327 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.194515 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.194655 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.194797 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.194936 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.195066 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.195195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.195324 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.195492 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.195643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.195812 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.195963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.196098 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.196231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.196372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.196513 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.196655 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.196795 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.196928 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.197067 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.197214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.197355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.197495 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.197628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.197769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.197902 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.198042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.198183 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.198316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.198490 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.198624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.198757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.198898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.199031 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.199170 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.199309 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.199442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.199573 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.199715 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.199888 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.200027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.200167 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.200301 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.200511 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.200646 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.200828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.200965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.201146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.201282 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.201460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.201599 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.201768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.201914 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.202134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.202280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.202427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.202547 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.202692 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.202814 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.203042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.203395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.203702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.203869 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.204040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.204177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.204350 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.204481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.204727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.204867 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.205149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.205419 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.205542 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.205654 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.205774 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.205894 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.206038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.206172 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.206349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.206472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.206660 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.206804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.207350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.207507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.207507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.207758 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.207946 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.208092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.208239 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.208444 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.208789 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.208933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.209111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.209283 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.209429 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.209624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.209770 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.209949 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.210092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.210290 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.210440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.210611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.210752 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.210926 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.211062 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.211235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.211378 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.211545 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.211680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.212731 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.212916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.213053 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.213177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.213298 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.213442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.213583 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.213723 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.213723 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.214203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.214343 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.214492 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.214634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.214777 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.214917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.215058 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.215191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.215323 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.215454 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.215601 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.215601 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.215993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.216128 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.216260 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.216405 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.216556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.216698 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.216831 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.216971 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.217103 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.217234 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.217379 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.217519 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.217653 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.217784 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.217914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.218054 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.218200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.218333 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.218463 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.218645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.218789 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.218958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.219099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.219231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.219363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.219501 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.219633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.219789 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.219924 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.220055 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.220213 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.220557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.220826 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.220972 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.221106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.221247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.221389 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.221530 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.221676 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.221810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.221954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.222096 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.222228 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.222369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.222510 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.222651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.222783 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.222925 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.223066 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.223207 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.223353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.223494 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.223634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.223807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.223958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.224093 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.224234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.224368 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.224507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.224648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.224787 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.224973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.225116 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.225249 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.225380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.225523 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.225656 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.225802 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.225942 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.226084 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.226217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.226356 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.226489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.226634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.226776 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.226917 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.227058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.227198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.227380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.227527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.227696 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.227871 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.228030 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.228167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.228338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.228475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.228644 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.228826 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.228968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.229109 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.229257 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.229398 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.229531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.229670 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.229841 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.229977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.230151 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.230296 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.230440 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.230574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.230749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.230886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.231054 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.231191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.231361 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.231496 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.231683 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.231986 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.232124 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.232267 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.232401 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.232534 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.232674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.232817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.232951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.233082 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.233214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.233355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.233531 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.234307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.234447 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.234562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.234562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.234736 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.234830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.234925 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.234925 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.235081 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.235172 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.235246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.235369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.235467 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.235673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.235764 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.236562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.236655 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.237556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.237664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.237664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.237815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.237815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.237960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.238109 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.238192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.238439 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.238523 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.238748 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.238880 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.239059 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.239152 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.239372 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.239457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.239687 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.239769 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.240022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.240116 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.240402 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.240496 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.240644 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.240751 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.240959 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.241062 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.241273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.241374 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.241584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.241688 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.241897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.241991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.242205 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.242299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.242518 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.242628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.242828 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.242923 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.243136 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.243230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.243449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.243556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.243757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.243922 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.244091 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.244183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.244402 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.244488 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.244710 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.244994 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.245078 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.245312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.245404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.245650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.245753 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.245977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.246061 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.246306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.246403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.246632 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.246716 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.246958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.247047 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.247269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.247362 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.247587 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.247670 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.248039 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.248184 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.248310 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.248432 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.248554 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.248665 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.248886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.249022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.249173 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.249303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.249484 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.249606 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.249794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.249917 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.250105 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.250228 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.250413 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.250543 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.250718 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.250839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.251027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.251151 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.251408 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.251598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.252318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.252441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.252650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.252917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.253040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.253249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.253373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.253574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.253697 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.253891 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.254015 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.254226 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.254357 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.254546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.254668 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.254859 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.254996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.255171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.255295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.255483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.255613 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.256378 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.256546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.256671 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.256785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.256905 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.257033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.257157 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.257288 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.257288 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.257499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.257619 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.257731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.257843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.257963 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.258077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.258189 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.258340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.258472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.258648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.258771 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.258982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.259119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.259267 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.259390 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.259579 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.259702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.259911 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.260044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.260226 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.260358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.260540 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.260671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.260853 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.260984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.261167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.261297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.261515 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.261657 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.261781 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.261902 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.262074 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.262211 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.262377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.262495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.262689 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.262813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.262996 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.263128 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.263302 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.263424 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.263615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.263747 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.263944 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.264085 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.264246 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.264375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.264553 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.264681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.264857 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.264987 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.265161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.265281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.265468 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.265588 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.265776 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.265906 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.266615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.266737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.266860 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.266975 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.267102 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.267247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.267361 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.267480 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.267593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.267726 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.267890 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.268025 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.268025 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.268292 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.268421 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.268541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.268733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.268849 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.268970 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.269129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.269247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.269369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.269632 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.269764 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.269981 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.270123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.270302 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.270441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.270612 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.270773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.270954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.271083 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.271226 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.271414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.271537 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.271750 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.271907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.272073 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.272205 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.272396 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.272519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.272724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.272869 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.273034 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.273166 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.273339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.273468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.273647 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.273775 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.273954 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.274086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.274260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.274382 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.274566 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.274694 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.274872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.275003 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.275177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.275307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.275477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.275606 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.275798 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.275938 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.276716 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.276865 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.276981 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.277102 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.277233 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.277350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.277469 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.277581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.277693 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.277812 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.277934 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.278055 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.278178 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.278298 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.278412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.278549 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.278663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.278784 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.278904 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.279017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.279192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.279314 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.279458 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.279582 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.279841 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.279972 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.280110 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.280232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.280412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.280536 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.280728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.280852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.281044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.281168 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.281360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.281489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.281677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.282009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.282142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.282257 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.282376 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.282488 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.282600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.282720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.283047 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.283185 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.283672 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.284029 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.284530 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.284859 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.285197 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.285611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.286664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.287009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.287009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.287009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.287491 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.288055 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.288404 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.289069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.289435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.289785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.290096 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.290261 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.290454 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.290606 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.290789 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.290962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.291111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.291265 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.291449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.291602 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.291808 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.291967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.292221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.292371 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.292529 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.292676 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.292831 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.292989 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.293137 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.293281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.293435 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.293596 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.293750 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.293897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.294108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.294281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.294428 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.294654 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.294803 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.294960 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.295106 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.295253 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.295413 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.295609 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.295759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.295941 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.296097 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.296244 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.296843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.297203 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.297362 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.297520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.297690 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.297837 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.297997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.298143 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.298297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.299244 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.299453 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.299602 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.299759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.299957 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.300114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.300268 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.300434 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.300596 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.300743 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.300743 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.301027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.301173 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.301326 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.301483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.301636 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.301636 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.301911 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.302064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.302237 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.302480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.302641 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.302788 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.302933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.303078 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.303239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.303395 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.303549 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.303704 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.303873 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.304033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.304195 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.304195 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.304484 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.304638 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.304783 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.304928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.305086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.305232 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.305377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.305521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.305674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.305830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.305830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.306127 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.306297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.306450 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.306616 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.307399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.307576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.307734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.307734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.308040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.308185 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.308344 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.308491 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.308636 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.308789 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.308963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.309110 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.309269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.309466 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.309619 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.309773 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.309927 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.310082 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.310238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.310386 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.310539 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.310686 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.310849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.311006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.311151 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.311303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.311450 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.311594 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.311738 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.311918 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.312083 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.312231 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.312377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.312608 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.312762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.312762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.313073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.313229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.313375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.313520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.313664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.313818 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.313964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.314184 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.314858 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.315015 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.315277 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.315571 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.315997 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.316168 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.316326 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.316481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.316642 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.316809 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.317700 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.317850 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.317996 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.318141 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.318299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.318299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.318578 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.318743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.318897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.319043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.319043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.320528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.320688 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.320845 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.320992 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.321146 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.321303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.321453 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.321599 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.321745 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.321904 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.322060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.322224 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.322377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.322525 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.322788 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.322943 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.323099 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.323296 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.323458 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.323614 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.323767 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.324001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.324167 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.324314 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.324460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.324615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.324772 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.324928 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.325074 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.325227 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.325373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.325519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.325519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.325813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.325970 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.326115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.326274 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.326420 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.326565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.326720 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.326867 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.327117 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.327650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.327924 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.328091 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.328248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.328500 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.328665 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.328821 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.328976 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.329204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.329360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.329514 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.329960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.330125 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.330282 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.330491 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.330717 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.330872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.331041 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.331188 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.331342 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.331503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.331651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.331873 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.332039 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.332187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.332349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.332513 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.332668 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.332920 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.333074 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.333241 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.333403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.333403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.333690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.333837 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.333999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.334153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.334309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.334464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.334611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.334611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.334894 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.335060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.335218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.335372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.335527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.335673 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.335849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.336002 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.336159 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.336159 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.336444 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.336597 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.336743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.336897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.337054 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.337733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.337914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.338171 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.338325 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.338505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.338768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.338928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.339076 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.339223 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.339370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.339532 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.339699 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.339868 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.340019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.340164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.340324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.340522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.340675 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.340821 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.340966 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.341129 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.341286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.341434 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.341581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.341740 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.341885 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.342040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.342193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.342397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.342562 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.342719 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.342873 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.343127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.343279 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.343429 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.343586 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.343742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.344014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.344174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.344174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.344462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.344616 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.344762 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.344916 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.345070 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.345224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.345981 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.346145 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.346323 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.346485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.346633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.346793 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.346940 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.347086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.347230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.347505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.348069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.348330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.348484 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.348643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.348922 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.349086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.349241 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.349398 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.349544 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.349691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.349846 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.350001 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.350161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.350323 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.350470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.350674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.350674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.350987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.351142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.351296 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.351442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.351588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.351742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.351742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.352099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.352253 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.352408 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.352564 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.352721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.352870 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.353027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.353274 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.353436 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.353593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.353747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.353902 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.354055 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.354210 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.354355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.354510 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.354663 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.354810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.354967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.355113 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.355266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.355426 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.355579 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.355734 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.355917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.356068 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.356227 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.356381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.356527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.356679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.356834 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.356999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.356999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.357289 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.357463 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.358061 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.358237 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.358492 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.358657 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.358805 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.359061 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.359217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.359372 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.359519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.359689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.359911 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.360066 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.360214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.360360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.360516 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.360737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.360916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.361608 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.361761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.361907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.362130 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.362499 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.362657 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.362812 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.362960 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.363115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.363291 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.363550 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.363704 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.363880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.364031 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.364191 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.364339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.364486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.364643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.364798 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.364945 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.365104 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.365251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.365397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.365542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.365689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.365835 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.365990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.366136 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.367549 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.368930 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.369380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.369537 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.369700 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.369850 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.369997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.370145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.370292 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.370455 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.370611 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.372274 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.372476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.372637 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.372811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.372811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.372811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.372811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.372811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:03:26.373672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.373672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.373672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.373672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.373672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.373672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.373672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.373672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.377251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.377251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.377251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.377251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.377251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.377251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.377251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.377251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.379829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.379829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.379829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.379829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.379829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.379829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.379829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.379829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.381044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.381044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.381044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.381044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.381044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.381044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.381044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.381044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.382167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.382167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.382167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.382167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.382167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.382167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.382167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.382167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.383317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.383317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.383317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.383317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.384013 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.384013 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.384013 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.384458 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.384647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.384989 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.385316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.385633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.386081 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.386406 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.386736 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.387069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.387390 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.387722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.388747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.388747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.388747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.389194 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.389350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.389800 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.390015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.390350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.390668 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.392231 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.392612 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.392975 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.393339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.393690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.394061 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.394399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.394738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.395071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.395403 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.395762 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.396113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.396444 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.396768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.397090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.397411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.397734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.398056 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.398787 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.399221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.400377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.400721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.401082 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.401400 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.401724 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.402090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.402441 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.402778 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.403120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.403453 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.403811 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.404144 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.404508 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.404815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.405150 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.405475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.405825 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.406150 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.406477 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.406803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.407198 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.407527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.408502 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.409295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.409650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.410215 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.410526 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.410865 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.411207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.411540 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.411942 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.412292 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.412619 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.412945 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.413269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.413858 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.414184 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.415201 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.415534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.416254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.416254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.421284 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.421284 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.421284 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.421916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.421916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.422270 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.427181 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.427570 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.427988 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.428356 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.428707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.429124 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.429467 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:03:26.429736 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:03:26.520664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO dbcounter [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Registered counter for database nova_api Aug 05 20:03:26.541391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_db.sqlalchemy.engines [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:03:26.548029 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writer thread running {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:03:26.581860 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO dbcounter [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Registered counter for database nova_api Aug 05 20:03:26.602303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_db.sqlalchemy.engines [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:03:26.605120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.context [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e(cell1) {{(pid=118174) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 20:03:26.609201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:26.609334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writer thread running {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:03:26.609680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:26.611919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:26.612705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:26.613328 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:26.617397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:26.617397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO dbcounter [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Registered counter for database nova_cell0 Aug 05 20:03:26.621431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO dbcounter [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Registered counter for database nova_cell1 Aug 05 20:03:26.630967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_db.sqlalchemy.engines [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:03:26.632194 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_db.sqlalchemy.engines [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:03:26.639019 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writer thread running {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:03:26.640321 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writer thread running {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:03:26.669916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.context [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e(cell1) {{(pid=118175) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 20:03:26.674878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:26.675545 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:26.677350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:26.678117 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:26.678580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:26.680629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:26.682762 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO dbcounter [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Registered counter for database nova_cell0 Aug 05 20:03:26.686805 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO dbcounter [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Registered counter for database nova_cell1 Aug 05 20:03:26.696067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_db.sqlalchemy.engines [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:03:26.697278 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_db.sqlalchemy.engines [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:03:26.703913 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writer thread running {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:03:26.709613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writer thread running {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:03:26.788115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO dbcounter [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Registered counter for database nova_cell0 Aug 05 20:03:26.797562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_db.sqlalchemy.engines [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:03:26.803010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writer thread running {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:03:26.859607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO dbcounter [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Registered counter for database nova_cell0 Aug 05 20:03:26.867377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_db.sqlalchemy.engines [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:03:26.871853 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writer thread running {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:03:27.122377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: WARNING keystonemiddleware.auth_token [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:03:27.129757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: WARNING keystonemiddleware.auth_token [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:03:27.194750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: WARNING keystonemiddleware.auth_token [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:03:27.202308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: WARNING keystonemiddleware.auth_token [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:03:27.470940 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: WARNING keystonemiddleware.auth_token [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:03:27.477308 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: WARNING keystonemiddleware.auth_token [None req-2b98a9c7-fbdc-4f94-ac64-8bee208a79b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:03:27.483764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555d6c5a9c0 pid: 118174 (default app) Aug 05 20:03:27.545810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: WARNING keystonemiddleware.auth_token [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:03:27.552661 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: WARNING keystonemiddleware.auth_token [None req-673f00a8-6a75-4ecf-b691-ec706fed56c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:03:27.558985 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555d6c5a9c0 pid: 118175 (default app) Aug 05 20:04:02.743389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=3 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.744429 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=3 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.745334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=3 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.746177 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=3 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:03.952730 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a5c03a92-b176-4382-bc27-67e65c2a0880 tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] Action: 'create', calling method: .version_select at 0x7f5693e29e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-214265807", "metadata": {"Type": "work"}}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:04.430063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:04.431479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:04.432709 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:04.432997 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:06.184348 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a5c03a92-b176-4382-bc27-67e65c2a0880 tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.460516 Aug 05 20:04:06.186726 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 1/1] 10.222.0.95 () {60 vars in 1156 bytes} [Fri Aug 5 20:04:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3465 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 20:04:06.201842 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8f1daba3-e034-408e-bead-42a9e47de8c7 tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] Calling method '.version_select at 0x7f5693c6dca0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:06.267558 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8f1daba3-e034-408e-bead-42a9e47de8c7 tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4" status: 200 len: 352 microversion: 2.1 time: 0.070748 Aug 05 20:04:06.268601 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 2/2] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:04:06 2022] GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:04:06.654250 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-16bee3b1-18a4-406d-b7f8-28ebc5cb3f48 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Action: 'create', calling method: .version_select at 0x7f5693d7cdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1322118227", "metadata": {"Type": "work"}}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-16bee3b1-18a4-406d-b7f8-28ebc5cb3f48 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Request method failure captured: Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 122 Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7Xe0s5iV38q82T-FH8e7aujamOHFiszXEDVkQNNjBj_kdwXiks9j3fJq7KFpnQ9HrU7S_8uY-CwGeG_3wmuWSeC_e_-YtBb3NmDyx599xgDHJtHDMjeTgvt7UjOo6afp-NE8WIsV_wAvuZ4ZmV6n00MG7Pj7HRsoaXyiBKParMhoFtw Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:04:06.660106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_7546ec15aa62489c87760b69b8545331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/7546ec15aa62489c87760b69b8545331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 3225736d7a7e4e20b40b5f3166f0d648 Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1322118227", "metadata": {"Type": "work"}}} Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: Aug 05 20:04:06.662370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1322118227', 'metadata': {'Type': 'work'}}}} Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise error Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:06.663364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 20:04:06.665414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 20:04:06.667804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 20:04:06.667804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.667804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-16bee3b1-18a4-406d-b7f8-28ebc5cb3f48 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:06.667804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-16bee3b1-18a4-406d-b7f8-28ebc5cb3f48 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.241464 Aug 05 20:04:06.667804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 1/3] 10.222.0.95 () {60 vars in 1156 bytes} [Fri Aug 5 20:04:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:04:06.676830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3315267d-11e8-466d-8d82-b4a2fb6ee8de tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Action: 'create', calling method: .version_select at 0x7f5693c0b310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1471925850", "metadata": {"Type": "work"}}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3315267d-11e8-466d-8d82-b4a2fb6ee8de tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Request method failure captured: Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 120 Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7Xe0s5iV38q82T-FH8e7aujamOHFiszXEDVkQNNjBj_kdwXiks9j3fJq7KFpnQ9HrU7S_8uY-CwGeG_3wmuWSeC_e_-YtBb3NmDyx599xgDHJtHDMjeTgvt7UjOo6afp-NE8WIsV_wAvuZ4ZmV6n00MG7Pj7HRsoaXyiBKParMhoFtw Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:04:06.682122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_7546ec15aa62489c87760b69b8545331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/7546ec15aa62489c87760b69b8545331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 3225736d7a7e4e20b40b5f3166f0d648 Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1471925850", "metadata": {"Type": "work"}}} Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: Aug 05 20:04:06.683473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1471925850', 'metadata': {'Type': 'work'}}}} Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise error Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi '0' Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:06.684565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 20:04:06.685985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 20:04:06.687318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 20:04:06.687318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.687318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3315267d-11e8-466d-8d82-b4a2fb6ee8de tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:06.687318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3315267d-11e8-466d-8d82-b4a2fb6ee8de tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010772 Aug 05 20:04:06.688853 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 3/4] 10.222.0.95 () {60 vars in 1156 bytes} [Fri Aug 5 20:04:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:04:06.707123 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6e502561-2683-4739-91c2-af554da6caec tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Action: 'create', calling method: .version_select at 0x7f5693c9d8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-987026201", "metadata": {"Type": "work"}}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6e502561-2683-4739-91c2-af554da6caec tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Request method failure captured: Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 118 Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7Xe0s5iV38q82T-FH8e7aujamOHFiszXEDVkQNNjBj_kdwXiks9j3fJq7KFpnQ9HrU7S_8uY-CwGeG_3wmuWSeC_e_-YtBb3NmDyx599xgDHJtHDMjeTgvt7UjOo6afp-NE8WIsV_wAvuZ4ZmV6n00MG7Pj7HRsoaXyiBKParMhoFtw Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:04:06.715933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_7546ec15aa62489c87760b69b8545331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/7546ec15aa62489c87760b69b8545331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 3225736d7a7e4e20b40b5f3166f0d648 Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-987026201", "metadata": {"Type": "work"}}} Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: Aug 05 20:04:06.717460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-987026201', 'metadata': {'Type': 'work'}}}} Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise error Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi '' Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:06.718364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 20:04:06.719901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 20:04:06.721449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 20:04:06.721449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.721449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6e502561-2683-4739-91c2-af554da6caec tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:06.721449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6e502561-2683-4739-91c2-af554da6caec tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024984 Aug 05 20:04:06.721449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 2/5] 10.222.0.95 () {60 vars in 1156 bytes} [Fri Aug 5 20:04:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:04:06.731683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-57909ec0-29ab-4707-96c6-723f6c5fa841 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Calling method '.version_select at 0x7f569457d280>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-57909ec0-29ab-4707-96c6-723f6c5fa841 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] HTTP exception thrown: Volume tempest-invalid-970177754 could not be found. Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-57909ec0-29ab-4707-96c6-723f6c5fa841 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Request method failure captured: Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-970177754 HTTP/1.1 Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7Xe0s5iV38q82T-FH8e7aujamOHFiszXEDVkQNNjBj_kdwXiks9j3fJq7KFpnQ9HrU7S_8uY-CwGeG_3wmuWSeC_e_-YtBb3NmDyx599xgDHJtHDMjeTgvt7UjOo6afp-NE8WIsV_wAvuZ4ZmV6n00MG7Pj7HRsoaXyiBKParMhoFtw Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:04:06.852225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_7546ec15aa62489c87760b69b8545331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/7546ec15aa62489c87760b69b8545331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 3225736d7a7e4e20b40b5f3166f0d648 Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Volume tempest-invalid-970177754 could not be found. Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'tempest-invalid-970177754'} Aug 05 20:04:06.855447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-970177754 could not be found. (HTTP 404) (Request-ID: req-67c84839-1abe-415b-a338-d163951d06c2) Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:06.856983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:04:06.859683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-970177754 could not be found. Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:06.865236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-970177754 could not be found. Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-970177754 could not be found. Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-57909ec0-29ab-4707-96c6-723f6c5fa841 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Returning 404 to user: Volume tempest-invalid-970177754 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-57909ec0-29ab-4707-96c6-723f6c5fa841 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/tempest-invalid-970177754" status: 404 len: 98 microversion: 2.1 time: 0.069703 Aug 05 20:04:06.869218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 4/6] 10.222.0.95 () {58 vars in 1215 bytes} [Fri Aug 5 20:04:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-970177754 => generated 98 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 20:04:06.871480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-87095bcf-4564-48a6-b4e2-c2afedd33658 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006746 Aug 05 20:04:06.871480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 3/7] 10.222.0.95 () {58 vars in 1140 bytes} [Fri Aug 5 20:04:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 20:04:06.871884 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f87745bd-f374-45df-ba51-eed869f40873 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008144 Aug 05 20:04:06.871884 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 5/8] 10.222.0.95 () {58 vars in 1137 bytes} [Fri Aug 5 20:04:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 20:04:06.872203 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6d8a8646-a70c-4c08-b368-137dc210bdbc tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Calling method '.version_select at 0x7f5693c47b80>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:07.285606 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-739a004d-97d4-4346-8d13-8851043a78b0 tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] Calling method '.version_select at 0x7f5693b99280>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:07.506320 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-6d8a8646-a70c-4c08-b368-137dc210bdbc tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] HTTP exception thrown: Volume f41d639a-6f00-4dea-9b21-4bddc6694d9a could not be found. Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6d8a8646-a70c-4c08-b368-137dc210bdbc tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Request method failure captured: Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: DELETE /compute/v2.1/os-volumes/f41d639a-6f00-4dea-9b21-4bddc6694d9a HTTP/1.1 Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7Xe0s5iV38q82T-FH8e7aujamOHFiszXEDVkQNNjBj_kdwXiks9j3fJq7KFpnQ9HrU7S_8uY-CwGeG_3wmuWSeC_e_-YtBb3NmDyx599xgDHJtHDMjeTgvt7UjOo6afp-NE8WIsV_wAvuZ4ZmV6n00MG7Pj7HRsoaXyiBKParMhoFtw Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:04:07.510328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_7546ec15aa62489c87760b69b8545331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/7546ec15aa62489c87760b69b8545331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 3225736d7a7e4e20b40b5f3166f0d648 Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Volume f41d639a-6f00-4dea-9b21-4bddc6694d9a could not be found. Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'f41d639a-6f00-4dea-9b21-4bddc6694d9a'} Aug 05 20:04:07.512021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f41d639a-6f00-4dea-9b21-4bddc6694d9a could not be found. (HTTP 404) (Request-ID: req-adf611b9-e740-461f-b248-1f950ed483b4) Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:07.512883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:04:07.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f41d639a-6f00-4dea-9b21-4bddc6694d9a could not be found. Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 20:04:07.515115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f41d639a-6f00-4dea-9b21-4bddc6694d9a could not be found. Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f41d639a-6f00-4dea-9b21-4bddc6694d9a could not be found. Aug 05 20:04:07.516196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.519170 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6d8a8646-a70c-4c08-b368-137dc210bdbc tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Returning 404 to user: Volume f41d639a-6f00-4dea-9b21-4bddc6694d9a could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:07.520386 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6d8a8646-a70c-4c08-b368-137dc210bdbc tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/f41d639a-6f00-4dea-9b21-4bddc6694d9a" status: 404 len: 109 microversion: 2.1 time: 0.680235 Aug 05 20:04:07.521512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 4/9] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:04:06 2022] DELETE /compute/v2.1/os-volumes/f41d639a-6f00-4dea-9b21-4bddc6694d9a => generated 109 bytes in 682 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:07.534280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e44b0080-9abc-46bc-9d5b-047de9a6a883 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Calling method '.version_select at 0x7f5693b8a790>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:07.600510 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-739a004d-97d4-4346-8d13-8851043a78b0 tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4" status: 200 len: 353 microversion: 2.1 time: 0.322738 Aug 05 20:04:07.601453 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 6/10] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:04:07 2022] GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4 => generated 353 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:07.615037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f8dfa54f-b625-43c7-9fed-4c4d3a3ebdbe tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] Calling method '.version_select at 0x7f5693c0d670>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:07.740901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-e44b0080-9abc-46bc-9d5b-047de9a6a883 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] HTTP exception thrown: Volume 9552596d-975c-47b3-b98e-94d8944d0d38 could not be found. Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e44b0080-9abc-46bc-9d5b-047de9a6a883 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Request method failure captured: Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/os-volumes/9552596d-975c-47b3-b98e-94d8944d0d38 HTTP/1.1 Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7Xe0s5iV38q82T-FH8e7aujamOHFiszXEDVkQNNjBj_kdwXiks9j3fJq7KFpnQ9HrU7S_8uY-CwGeG_3wmuWSeC_e_-YtBb3NmDyx599xgDHJtHDMjeTgvt7UjOo6afp-NE8WIsV_wAvuZ4ZmV6n00MG7Pj7HRsoaXyiBKParMhoFtw Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:04:07.743504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_7546ec15aa62489c87760b69b8545331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/7546ec15aa62489c87760b69b8545331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/7546ec15aa62489c87760b69b8545331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 7546ec15aa62489c87760b69b8545331 Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-VolumesNegativeTest-1861641729 Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 3225736d7a7e4e20b40b5f3166f0d648 Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-VolumesNegativeTest-1861641729-project Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Volume 9552596d-975c-47b3-b98e-94d8944d0d38 could not be found. Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '9552596d-975c-47b3-b98e-94d8944d0d38'} Aug 05 20:04:07.744965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9552596d-975c-47b3-b98e-94d8944d0d38 could not be found. (HTTP 404) (Request-ID: req-bb983cd8-3f6e-4681-a92d-5ece352be3e4) Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:07.745745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:04:07.747099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9552596d-975c-47b3-b98e-94d8944d0d38 could not be found. Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:04:07.750635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9552596d-975c-47b3-b98e-94d8944d0d38 could not be found. Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9552596d-975c-47b3-b98e-94d8944d0d38 could not be found. Aug 05 20:04:07.753565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:04:07.758111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e44b0080-9abc-46bc-9d5b-047de9a6a883 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] Returning 404 to user: Volume 9552596d-975c-47b3-b98e-94d8944d0d38 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:07.759876 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e44b0080-9abc-46bc-9d5b-047de9a6a883 tempest-VolumesNegativeTest-1861641729 tempest-VolumesNegativeTest-1861641729-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/9552596d-975c-47b3-b98e-94d8944d0d38" status: 404 len: 109 microversion: 2.1 time: 0.232405 Aug 05 20:04:07.760942 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 5/11] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:04:07 2022] GET /compute/v2.1/os-volumes/9552596d-975c-47b3-b98e-94d8944d0d38 => generated 109 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:07.782535 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b436d6ea-4735-46ef-8a8b-64062eef916d tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693b8a310>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:07.841378 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f8dfa54f-b625-43c7-9fed-4c4d3a3ebdbe tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4" status: 200 len: 353 microversion: 2.1 time: 0.231750 Aug 05 20:04:07.853520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 7/12] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:04:07 2022] GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4 => generated 353 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:07.866745 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-49c6a55d-b943-44c5-8002-80e8837bb58a tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] Calling method '.version_select at 0x7f5693c0b3a0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:07.976733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b436d6ea-4735-46ef-8a8b-64062eef916d tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/cc098f10-f2aa-4b8b-8682-88d15740bd0b" status: 200 len: 349 microversion: 2.1 time: 0.214529 Aug 05 20:04:07.977666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 6/13] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:04:07 2022] GET /compute/v2.1/os-volumes/cc098f10-f2aa-4b8b-8682-88d15740bd0b => generated 349 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:08.125574 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-49c6a55d-b943-44c5-8002-80e8837bb58a tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4" status: 202 len: 0 microversion: 2.1 time: 0.262314 Aug 05 20:04:08.126250 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 8/14] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:04:07 2022] DELETE /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:04:08.136571 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ae96446c-cfce-4c82-b98b-30ddf5d1620b tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] Calling method '.version_select at 0x7f5693b8a5e0>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:08.324943 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ae96446c-cfce-4c82-b98b-30ddf5d1620b tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4" status: 200 len: 352 microversion: 2.1 time: 0.193999 Aug 05 20:04:08.331113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 7/15] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:04:08 2022] GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4 => generated 352 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:09.344625 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4797f8e4-9dd9-4618-9f79-bad6ec0a929c tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] Calling method '.version_select at 0x7f5693b993a0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:09.410240 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-4797f8e4-9dd9-4618-9f79-bad6ec0a929c tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] HTTP exception thrown: Volume c7853e22-1cbb-42a8-8f46-9392ad8e18b4 could not be found. Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4797f8e4-9dd9-4618-9f79-bad6ec0a929c tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] Request method failure captured: Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4 HTTP/1.1 Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XeyiA0Nke5XMNPiWWx9vGQNXBis8dJCyemXoUMj4gubGtNKQ26EVpeAqEFtr5xTUHUkFVFtuj6rDm6MYsAsIF7c-RFpqFOG9A0ZURIi_bErdW93pZhaQyLw7uKQTIJ-aIXou6VMcrLqmv99xsHnBIk4POSc83S1rFvjtKu6df1N-jI Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: c39f340d77b141f581dce9c25ca3d30c Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-VolumesGetTestJSON-1444786209 Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:04:09.413038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/c39f340d77b141f581dce9c25ca3d30c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_c39f340d77b141f581dce9c25ca3d30c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/c39f340d77b141f581dce9c25ca3d30c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/c39f340d77b141f581dce9c25ca3d30c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-VolumesGetTestJSON-1444786209 Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: c39f340d77b141f581dce9c25ca3d30c Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-VolumesGetTestJSON-1444786209 Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-VolumesGetTestJSON-1444786209-project Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 4983049d329a449785ce1182b4f4dce5 Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-VolumesGetTestJSON-1444786209-project Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Volume c7853e22-1cbb-42a8-8f46-9392ad8e18b4 could not be found. Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'c7853e22-1cbb-42a8-8f46-9392ad8e18b4'} Aug 05 20:04:09.414299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7853e22-1cbb-42a8-8f46-9392ad8e18b4 could not be found. (HTTP 404) (Request-ID: req-325883d2-41af-4e89-8869-829a1ea87771) Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:09.415115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:04:09.416422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7853e22-1cbb-42a8-8f46-9392ad8e18b4 could not be found. Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:04:09.417304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7853e22-1cbb-42a8-8f46-9392ad8e18b4 could not be found. Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7853e22-1cbb-42a8-8f46-9392ad8e18b4 could not be found. Aug 05 20:04:09.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:04:09.419397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4797f8e4-9dd9-4618-9f79-bad6ec0a929c tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] Returning 404 to user: Volume c7853e22-1cbb-42a8-8f46-9392ad8e18b4 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:09.420510 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4797f8e4-9dd9-4618-9f79-bad6ec0a929c tempest-VolumesGetTestJSON-1444786209 tempest-VolumesGetTestJSON-1444786209-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4" status: 404 len: 109 microversion: 2.1 time: 0.085495 Aug 05 20:04:09.421606 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 9/16] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:04:09 2022] GET /compute/v2.1/os-volumes/c7853e22-1cbb-42a8-8f46-9392ad8e18b4 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:10.008509 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3c29f621-b80e-46f8-9225-c6ebf48ff579 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693b98700>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:10.154572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3c29f621-b80e-46f8-9225-c6ebf48ff579 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/881af28e-dc25-47a7-a87f-0ec5729ccc6f" status: 200 len: 351 microversion: 2.1 time: 0.151227 Aug 05 20:04:10.166560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 8/17] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:04:09 2022] GET /compute/v2.1/os-volumes/881af28e-dc25-47a7-a87f-0ec5729ccc6f => generated 351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:11.934040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ea90d732-b60c-49ae-ae51-b6b8a790c401 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f569444b940>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:12.026234 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ea90d732-b60c-49ae-ae51-b6b8a790c401 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/cc7ab433-39e5-49f2-9052-6ebc219b768c" status: 200 len: 350 microversion: 2.1 time: 0.095905 Aug 05 20:04:12.027222 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 10/18] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:04:11 2022] GET /compute/v2.1/os-volumes/cc7ab433-39e5-49f2-9052-6ebc219b768c => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:12.041591 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-94e2d295-1b04-439f-92f8-d77443b2dba7 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693b98dc0>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:12.262417 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-94e2d295-1b04-439f-92f8-d77443b2dba7 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.225120 Aug 05 20:04:12.263259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 9/19] 10.222.0.95 () {58 vars in 1134 bytes} [Fri Aug 5 20:04:12 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:12.281028 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b586f867-426a-456d-86d9-da63c99ff07d tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693c0df70>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:12.493837 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b586f867-426a-456d-86d9-da63c99ff07d tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.217462 Aug 05 20:04:12.494276 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 11/20] 10.222.0.95 () {58 vars in 1149 bytes} [Fri Aug 5 20:04:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:12.524467 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9bded8d5-41ee-42eb-a276-6f4eb5a4a074 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693b989d0>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:12.810397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9bded8d5-41ee-42eb-a276-6f4eb5a4a074 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.304428 Aug 05 20:04:12.811604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 10/21] 10.222.0.95 () {58 vars in 1134 bytes} [Fri Aug 5 20:04:12 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:12.838152 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-96e5909e-183d-408d-81b2-112a8e3397e7 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693c0be50>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:13.055665 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-96e5909e-183d-408d-81b2-112a8e3397e7 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.233009 Aug 05 20:04:13.057208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 12/22] 10.222.0.95 () {58 vars in 1167 bytes} [Fri Aug 5 20:04:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:13.073916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4a7ce729-4495-4ff8-86f8-48e460b1faf0 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693b8a670>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:13.285715 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4a7ce729-4495-4ff8-86f8-48e460b1faf0 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.215061 Aug 05 20:04:13.301203 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 11/23] 10.222.0.95 () {58 vars in 1170 bytes} [Fri Aug 5 20:04:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:13.306517 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cf0669cc-f1dd-4922-82a9-caf2d36a7a5c tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693ba33a0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:13.593697 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cf0669cc-f1dd-4922-82a9-caf2d36a7a5c tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.290994 Aug 05 20:04:13.594562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 13/24] 10.222.0.95 () {58 vars in 1155 bytes} [Fri Aug 5 20:04:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:13.611062 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4dbd88b3-62aa-48b0-901f-259bd5fcb96d tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693ba5b80>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:13.820770 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4dbd88b3-62aa-48b0-901f-259bd5fcb96d tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.212777 Aug 05 20:04:13.846708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 12/25] 10.222.0.95 () {58 vars in 1188 bytes} [Fri Aug 5 20:04:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:13.852372 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b13bc316-6787-410c-b483-e9e7255c3ee8 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] Calling method '.version_select at 0x7f5693b9d5e0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:14.133204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b13bc316-6787-410c-b483-e9e7255c3ee8 tempest-VolumesTestJSON-2067672032 tempest-VolumesTestJSON-2067672032-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.296730 Aug 05 20:04:14.154333 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 14/26] 10.222.0.95 () {58 vars in 1155 bytes} [Fri Aug 5 20:04:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:17.765154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1a6063be-a749-43dc-ace0-fa8b400c4ef0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'create', calling method: .version_select at 0x7f5693c47280>, body: {"keypair": {"name": "tempest-keypair-1141211401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmxKUIrqN71qomZ4APU0XStA4YLKcT+5OXK0bo+abQfpnAfZ7416mS+FlWTGziqNZ0oBS1jC6i5lBQLJH8czkweYyNtPO4IBHDBu8ikXMGw4Tum2hkwyHkyzN2omnbeow=="}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:17.962802 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-1a6063be-a749-43dc-ace0-fa8b400c4ef0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Getting quotas for project 0520f87324854dd0a5d0c9e10caa7fda. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:04:17.995160 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-1a6063be-a749-43dc-ace0-fa8b400c4ef0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Getting quotas for user edf898f67aca42db8d51924ca4d8a300 and project 0520f87324854dd0a5d0c9e10caa7fda. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:04:18.128430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1a6063be-a749-43dc-ace0-fa8b400c4ef0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.739636 Aug 05 20:04:18.129377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 13/27] 10.222.0.95 () {62 vars in 1200 bytes} [Fri Aug 5 20:04:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 741 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 20:04:21.952883 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-167581127", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "networks": [{"uuid": "a82d1e80-5287-4756-9423-8775acb54354"}]}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:22.135075 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9c523119-c898-4966-832a-f90812ddede9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: .version_select at 0x7f5693b69af0>, body: {"keypair": {"name": "tempest-keypair-1024977831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRwyZj4uU2PaNvmBtCHrdEfcPCa42yMtzxIdUg+xH6gEi8YtuyWdtWEBLIpqQuqJsajUG6ilUwXPAXw+WvT0WYcIxeE+PyplGwVrYOYcqNLze8OlvQSEI0TzPsfHIAe/w=="}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:22.195136 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-9c523119-c898-4966-832a-f90812ddede9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for project 43323ff64b8843639e0428c69d5c71c1. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:04:22.212191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-9c523119-c898-4966-832a-f90812ddede9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for user 67e79817ed9e40728f92a22053a24118 and project 43323ff64b8843639e0428c69d5c71c1. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:04:22.249482 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] validate_networks() for [('a82d1e80-5287-4756-9423-8775acb54354', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:04:22.286042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9c523119-c898-4966-832a-f90812ddede9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.755508 Aug 05 20:04:22.295325 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 14/28] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:04:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:22.966071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1596843108", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5382f35a-6213-4f6e-b86e-02098406e5c9"}], "security_groups": [{"name": "tempest-securitygroup--1577481327"}], "key_name": "tempest-keypair-1141211401", "user_data": "}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:23.507823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.network.neutron [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] validate_networks() for [('5382f35a-6213-4f6e-b86e-02098406e5c9', None, None, None, None, None)] {{(pid=118175) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:04:26.110869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:04:26.111359 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:04:26.111891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:04:26.112309 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:04:26.113307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:04:26.144251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:26.148700 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:26.149403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:26.151652 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:26.152395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:26.152980 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:26.231358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Getting quotas for project 2d9f205b7bd747c7b51ff51aa328a3cc. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:04:26.250384 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Getting quotas for user 083840b9867145389ebf9cb035f0aba1 and project 2d9f205b7bd747c7b51ff51aa328a3cc. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:04:26.278889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:04:26.282507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:04:26.424297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-415aa63d-7efb-4fec-904c-8529507caa45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.908383 Aug 05 20:04:26.426650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 15/29] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:04:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:04:26.445020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ab9651b3-9e64-4500-8fb5-25dd58750534 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:26.453760 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ab9651b3-9e64-4500-8fb5-25dd58750534 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:26.705440 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ab9651b3-9e64-4500-8fb5-25dd58750534 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:26.741094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ab9651b3-9e64-4500-8fb5-25dd58750534 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1214 microversion: 2.1 time: 0.301728 Aug 05 20:04:26.744228 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 16/30] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:26 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1214 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:27.322583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Flavor limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:04:27.324615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Image limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:04:27.325571 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Flavor pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:04:27.326275 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Image pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:04:27.330686 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:04:27.360804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:27.361457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:27.363158 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:27.364096 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:27.364717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:27.365303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:27.404611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Getting quotas for project 0520f87324854dd0a5d0c9e10caa7fda. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:04:27.418383 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Getting quotas for user edf898f67aca42db8d51924ca4d8a300 and project 0520f87324854dd0a5d0c9e10caa7fda. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:04:27.437954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Going to run 1 instances... {{(pid=118175) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:04:27.441938 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118175) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:04:27.568327 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4ff7ea50-da32-4a94-b403-81ebcfff878b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.607616 Aug 05 20:04:27.569207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 15/31] 10.222.0.95 () {62 vars in 1188 bytes} [Fri Aug 5 20:04:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 4609 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 20:04:27.581389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-284df2de-4d9a-4a30-b401-a5d7dde645a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:27.583424 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-284df2de-4d9a-4a30-b401-a5d7dde645a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:27.610380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1421331975", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e6eb1b0-c7d1-48fb-bae8-24a190109c29"}], "security_groups": [{"name": "tempest-securitygroup--2051808510"}], "key_name": "tempest-keypair-1024977831", "user_data": "}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:27.738960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-284df2de-4d9a-4a30-b401-a5d7dde645a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:27.758937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-284df2de-4d9a-4a30-b401-a5d7dde645a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:27.765313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-284df2de-4d9a-4a30-b401-a5d7dde645a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:27.768858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-284df2de-4d9a-4a30-b401-a5d7dde645a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1282 microversion: 2.20 time: 0.192404 Aug 05 20:04:27.789185 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 17/32] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:27 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:27.806007 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-51e87828-e164-4468-bc20-3628fa91b949 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:27.807678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-51e87828-e164-4468-bc20-3628fa91b949 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:27.960449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-51e87828-e164-4468-bc20-3628fa91b949 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:27.973245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-51e87828-e164-4468-bc20-3628fa91b949 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1214 microversion: 2.1 time: 0.181173 Aug 05 20:04:27.974378 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 18/33] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:27 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:27.989721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.network.neutron [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] validate_networks() for [('0e6eb1b0-c7d1-48fb-bae8-24a190109c29', None, None, None, None, None)] {{(pid=118175) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:04:28.797320 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c0f3e087-2609-46e8-a3e7-02191ab6a070 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:28.798303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c0f3e087-2609-46e8-a3e7-02191ab6a070 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:28.871973 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Flavor limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:04:28.873057 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Image limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:04:28.873861 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Flavor pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:04:28.874434 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Image pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:04:28.875000 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:04:28.877732 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c0f3e087-2609-46e8-a3e7-02191ab6a070 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:28.887715 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:28.888420 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:28.889011 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:28.889906 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:28.890512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:28.891075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c0f3e087-2609-46e8-a3e7-02191ab6a070 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:28.891263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:28.893557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c0f3e087-2609-46e8-a3e7-02191ab6a070 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:28.895505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c0f3e087-2609-46e8-a3e7-02191ab6a070 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1282 microversion: 2.20 time: 0.103726 Aug 05 20:04:28.896514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 19/34] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:28 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:28.910516 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for project 43323ff64b8843639e0428c69d5c71c1. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:04:28.914589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for user 67e79817ed9e40728f92a22053a24118 and project 43323ff64b8843639e0428c69d5c71c1. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:04:28.950589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Going to run 1 instances... {{(pid=118175) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:04:28.953021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118175) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:04:28.995303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4fb23e1d-a3c2-4b40-bf18-ec7efe7e7cc6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:28.995986 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4fb23e1d-a3c2-4b40-bf18-ec7efe7e7cc6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:29.061587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-52656973-7b71-4b82-ae68-014cbd92f1ce tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.459537 Aug 05 20:04:29.062754 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 16/35] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:04:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 20:04:29.074019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c1efa49f-bbad-4ffb-be4b-fa172a7fade3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:29.076641 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c1efa49f-bbad-4ffb-be4b-fa172a7fade3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:29.102912 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4fb23e1d-a3c2-4b40-bf18-ec7efe7e7cc6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:29.117963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4fb23e1d-a3c2-4b40-bf18-ec7efe7e7cc6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1214 microversion: 2.1 time: 0.125977 Aug 05 20:04:29.136880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 20/36] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:28 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:29.318984 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c1efa49f-bbad-4ffb-be4b-fa172a7fade3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:29.359568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c1efa49f-bbad-4ffb-be4b-fa172a7fade3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1242 microversion: 2.1 time: 0.288175 Aug 05 20:04:29.360210 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 17/37] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:29 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1242 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:29.920057 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:29.921026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:29.938422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:29.940013 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:29.941764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:29.943722 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:29.944426 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:29.945240 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.146982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:30.147631 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:30.170683 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.171446 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.172145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.173171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.173801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.174564 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.210979 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:30.229560 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:30.236035 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:30.237983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-22954011-efb4-439f-b21c-f245085f18b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1278 microversion: 2.20 time: 0.322743 Aug 05 20:04:30.239572 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 21/38] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:29 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1278 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:30.342429 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:30.354689 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7378b424-0063-4e8b-9d41-89520b01911f tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1266 microversion: 2.1 time: 0.214565 Aug 05 20:04:30.355277 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 18/39] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:30 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:30.387005 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:30.387762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:30.395534 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.396042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.396472 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.397179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.397627 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.398274 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.477125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:30.484945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cf7c64b8-3217-4133-b823-ae3294e8a525 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1294 microversion: 2.1 time: 0.102532 Aug 05 20:04:30.485692 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 22/40] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:30 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:31.280189 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:31.286263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:31.303733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.304616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.305817 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.307219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.307882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.308475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.377414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:31.379805 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:31.391421 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.396306 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.401409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.407477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.408179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.411682 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.451419 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:31.461285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:31.467954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:31.474225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-df594bad-359e-4d00-ad07-f01301f1b8e8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1352 microversion: 2.20 time: 0.211368 Aug 05 20:04:31.476836 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 19/41] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:31 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1352 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:31.521909 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:31.525927 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:31.551520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.553672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.557121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.562927 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.567355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.568791 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.635264 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:31.654483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-bc9151ea-8327-4126-8bd9-9bd885bad3a3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1284 microversion: 2.1 time: 0.272912 Aug 05 20:04:31.655449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 23/42] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:31 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1284 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:31.780498 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:31.790930 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f03da549-2823-456a-85b9-b0eda976772e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1302 microversion: 2.1 time: 0.285150 Aug 05 20:04:31.797933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 20/43] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:31 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1302 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:32.502433 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:32.502973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:32.510630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:32.511737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:32.512221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:32.513123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:32.513589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:32.515319 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:32.682169 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:32.683257 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:32.701366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:32.703017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:32.703481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:32.707608 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:32.711309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:32.711885 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:33.002279 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:33.026364 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:33.028078 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:33.040582 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-237f086e-a14c-46a6-a448-aa2019156946 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1340 microversion: 2.20 time: 0.531207 Aug 05 20:04:33.041136 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 24/44] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:32 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1340 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:33.059427 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:33.060528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:33.075958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:33.076491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:33.076947 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:33.077822 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:33.078149 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:33.090356 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:33.522792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:33.527815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a9cc0003-8c5b-45b7-81df-cf50c9af75a9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.851919 Aug 05 20:04:33.533713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 21/45] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:32 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:33.646855 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:33.676700 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e52990ab-732a-4967-bc08-c424ac9beb46 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1300 microversion: 2.1 time: 0.633293 Aug 05 20:04:33.679263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 25/46] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:33 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1300 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:34.070709 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:34.071325 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:34.088307 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.089787 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.091391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.093346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.095398 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.103518 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.326684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:34.357083 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:34.366343 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:34.372857 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4dd05e9f-8264-48bc-bd2f-252ae175202a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1340 microversion: 2.20 time: 0.306637 Aug 05 20:04:34.382697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 22/47] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:34 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1340 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:34.561247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:34.562989 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:34.584154 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.584669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.588762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.591695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.593622 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.596567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.701451 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:34.702311 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:34.714154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.714975 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.718607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.719802 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.720484 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.721904 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.951158 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:34.964225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-307795ac-4b0d-44bd-be4e-0e582b524589 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1300 microversion: 2.1 time: 0.267339 Aug 05 20:04:34.966917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 23/48] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:34 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1300 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:35.407803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:35.409415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:35.430563 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:35.431062 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:35.434915 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:35.436546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:35.438424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:35.439693 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:35.696544 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:35.704599 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-97f20421-f299-4471-b7b6-bef824005449 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 1.149399 Aug 05 20:04:35.719972 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 26/49] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:34 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:35.991902 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:35.993279 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:36.015600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:36.016632 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:36.017363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:36.020529 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:36.021221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:36.023897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:36.205033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:36.662844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:36.679024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:36.685458 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:36.697369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-41d998a4-4110-4c3e-a4d1-ece71a0442b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 1.293468 Aug 05 20:04:36.712084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 24/50] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:35 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:04:36.726757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:36.736037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:36.736666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:36.742953 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-76890642-73f1-473d-8184-23c4462310b6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.756592 Aug 05 20:04:36.744075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 27/51] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:35 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:36.771869 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:36.772428 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:36.772872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:36.773601 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:36.774060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:36.774494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:37.738675 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:37.741136 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:37.774827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:37.775553 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:37.776178 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:37.779655 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:37.780530 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:37.781294 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:37.907003 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:37.929065 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f5e8471f-565f-4725-90b2-9d6408c78472 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 1.197649 Aug 05 20:04:37.944466 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 25/52] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:36 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:37.959019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:37.964175 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:37.999418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:38.000271 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:38.001039 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:38.015022 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:38.017119 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:38.018001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:38.901453 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=4 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:38.949253 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:38.960144 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:38.972925 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:38.981106 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cde16851-8b0f-46e7-b10c-50e3057ffab0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 1.249887 Aug 05 20:04:38.985038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 28/53] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:37 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:39.118251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-22ad170b-899e-4b22-98ce-88d809bc1d93 req-4e0466df-1779-4467-b5ee-36149243505e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80", "tag": "4ca867f4-ff8b-46d2-bc1a-eb82e50fa8a0"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:39.124321 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=16 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:39.168567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-22ad170b-899e-4b22-98ce-88d809bc1d93 req-4e0466df-1779-4467-b5ee-36149243505e service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:39.169186 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-22ad170b-899e-4b22-98ce-88d809bc1d93 req-4e0466df-1779-4467-b5ee-36149243505e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:39.169714 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-22ad170b-899e-4b22-98ce-88d809bc1d93 req-4e0466df-1779-4467-b5ee-36149243505e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:39.250315 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-22ad170b-899e-4b22-98ce-88d809bc1d93 req-4e0466df-1779-4467-b5ee-36149243505e service nova] Creating event network-changed:4ca867f4-ff8b-46d2-bc1a-eb82e50fa8a0 for instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 on hv-cinder-85221 Aug 05 20:04:39.251041 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-22ad170b-899e-4b22-98ce-88d809bc1d93 req-4e0466df-1779-4467-b5ee-36149243505e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118174) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 20:04:39.251733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-22ad170b-899e-4b22-98ce-88d809bc1d93 req-4e0466df-1779-4467-b5ee-36149243505e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118174) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 20:04:39.256739 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f03b7e5e-698c-4ab2-a67a-ee1a98af0708 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:39.258926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f03b7e5e-698c-4ab2-a67a-ee1a98af0708 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:39.259512 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f03b7e5e-698c-4ab2-a67a-ee1a98af0708 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:39.262946 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f03b7e5e-698c-4ab2-a67a-ee1a98af0708 None None] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:39.264885 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f03b7e5e-698c-4ab2-a67a-ee1a98af0708 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:39.265543 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f03b7e5e-698c-4ab2-a67a-ee1a98af0708 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:39.271369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:39.284530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5d63a8a5-22ce-4416-9671-80a4eef51fea tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 1.336483 Aug 05 20:04:39.295034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 26/54] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:37 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:39.304988 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.compute.rpcapi [None req-f03b7e5e-698c-4ab2-a67a-ee1a98af0708 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 20:04:39.306154 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f03b7e5e-698c-4ab2-a67a-ee1a98af0708 None None] Releasing lock "compute-rpcapi-router" {{(pid=118174) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 20:04:39.313820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:39.317991 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:39.337520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f03b7e5e-698c-4ab2-a67a-ee1a98af0708 None None] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350882 Aug 05 20:04:39.338305 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 29/55] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:39.345888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:39.348412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:39.349853 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:39.356177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:39.356963 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:39.358912 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:39.365338 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=22 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:39.939435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:39.966025 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-74ae62ff-3469-445a-b918-2874034817d6 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.667634 Aug 05 20:04:39.989616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 27/56] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:39 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:40.016188 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:40.017271 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:40.055155 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.059447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.062481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.070065 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.074300 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.075505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.440027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-2c0adcb9-f9df-4f77-9a28-ddfa311870ab req-76f3d224-5663-4602-9332-427aacd6d100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96010245-806a-4bf6-90fb-2a70ac2a17ec", "tag": "c56b1bbe-d959-41b4-ba80-de2afa26f697"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:40.473033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2c0adcb9-f9df-4f77-9a28-ddfa311870ab req-76f3d224-5663-4602-9332-427aacd6d100 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.474219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2c0adcb9-f9df-4f77-9a28-ddfa311870ab req-76f3d224-5663-4602-9332-427aacd6d100 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.474761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2c0adcb9-f9df-4f77-9a28-ddfa311870ab req-76f3d224-5663-4602-9332-427aacd6d100 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.567244 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-2c0adcb9-f9df-4f77-9a28-ddfa311870ab req-76f3d224-5663-4602-9332-427aacd6d100 service nova] Creating event network-changed:c56b1bbe-d959-41b4-ba80-de2afa26f697 for instance 96010245-806a-4bf6-90fb-2a70ac2a17ec on hv-cinder-85221 Aug 05 20:04:40.567681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2c0adcb9-f9df-4f77-9a28-ddfa311870ab req-76f3d224-5663-4602-9332-427aacd6d100 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118175) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 20:04:40.575643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2c0adcb9-f9df-4f77-9a28-ddfa311870ab req-76f3d224-5663-4602-9332-427aacd6d100 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118175) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 20:04:40.577061 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d281fcda-a53b-422c-a101-e67aab0451f2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.577714 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d281fcda-a53b-422c-a101-e67aab0451f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.578207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d281fcda-a53b-422c-a101-e67aab0451f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.579092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d281fcda-a53b-422c-a101-e67aab0451f2 None None] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.579627 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d281fcda-a53b-422c-a101-e67aab0451f2 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.580206 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d281fcda-a53b-422c-a101-e67aab0451f2 None None] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.639218 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.compute.rpcapi [None req-d281fcda-a53b-422c-a101-e67aab0451f2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 20:04:40.641001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d281fcda-a53b-422c-a101-e67aab0451f2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118175) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 20:04:40.691871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d281fcda-a53b-422c-a101-e67aab0451f2 None None] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.398455 Aug 05 20:04:40.693183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 28/57] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:40.701181 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:40.704709 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:40.715711 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.717718 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.718338 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.724397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.726435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.727181 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.982785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:41.019714 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:41.023567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:41.032955 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:41.037595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-07f70cb4-6168-4f96-9bbf-20e363eb8b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.338099 Aug 05 20:04:41.037595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 29/58] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:40 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:41.038039 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-82bf90cb-c7db-4351-8244-9b1b7ebae7d5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 1.028547 Aug 05 20:04:41.040531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 30/59] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:40 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:41.071545 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:41.074579 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:41.094942 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:41.098262 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:41.099007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:41.102496 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:41.103308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:41.105140 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:41.452473 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:41.463592 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9690cf4a-f967-449b-a030-7e886410e628 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.410754 Aug 05 20:04:41.464856 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 30/60] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:41 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:42.066928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:42.068312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:42.071967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:42.073041 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:42.093757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:42.095652 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:42.097120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:42.099328 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:42.100183 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:42.100836 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:42.104602 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:42.107145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:42.108633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:42.120084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:42.120934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:42.121898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:42.530648 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:42.547739 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:42.549379 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:42.554887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6495d45a-6931-4e90-a1a3-46502052b7a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.488607 Aug 05 20:04:42.555676 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 31/61] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:42 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:42.564209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:42.567916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:42.581456 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:42.582148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:42.584431 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:42.586053 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:42.587383 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:42.592817 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:42.967896 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:42.992659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8c05436e-3ef1-4980-8b0d-b00b0874306e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.434048 Aug 05 20:04:42.996202 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 32/62] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:42 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:43.390434 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-a3ca673b-39b8-4585-bcc4-cc1524a62095 req-a9870924-de3e-44e9-b48b-7513e3bd7e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49e6225-f22b-44fc-ad77-be5500dd95ca", "tag": "1bdc744a-8e2b-4857-9c57-b9ac61ab593c"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:43.406524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-a3ca673b-39b8-4585-bcc4-cc1524a62095 req-a9870924-de3e-44e9-b48b-7513e3bd7e3c service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:43.407342 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-a3ca673b-39b8-4585-bcc4-cc1524a62095 req-a9870924-de3e-44e9-b48b-7513e3bd7e3c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:43.408820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-a3ca673b-39b8-4585-bcc4-cc1524a62095 req-a9870924-de3e-44e9-b48b-7513e3bd7e3c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:43.439332 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-a3ca673b-39b8-4585-bcc4-cc1524a62095 req-a9870924-de3e-44e9-b48b-7513e3bd7e3c service nova] Creating event network-changed:1bdc744a-8e2b-4857-9c57-b9ac61ab593c for instance a49e6225-f22b-44fc-ad77-be5500dd95ca on hv-cinder-85221 Aug 05 20:04:43.450623 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-a3ca673b-39b8-4585-bcc4-cc1524a62095 req-a9870924-de3e-44e9-b48b-7513e3bd7e3c service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068455 Aug 05 20:04:43.451940 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 33/63] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:04:43.539285 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:43.549353 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-39908e10-b70c-4f4e-9939-c1d59c66f164 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 1.495188 Aug 05 20:04:43.553763 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 31/64] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:42 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:43.581524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:43.583131 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:43.598115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:43.601050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:43.601572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:43.605697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:43.606701 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:43.608312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:44.018668 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:44.019535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:44.023243 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:44.030900 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:44.031554 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:44.032088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:44.032909 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:44.052878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:44.053705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:44.304832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:44.308821 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:44.317259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:44.325792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:44.327768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-08b045f9-3506-4e71-abd9-df4accbe952b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.752995 Aug 05 20:04:44.333602 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 34/65] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:43 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:44.574364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:44.575148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:44.580491 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:44.582996 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:44.584507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:44.585171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:44.586135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:44.586699 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:44.587527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:44.657196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:44.686511 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-20b2e879-1499-4606-97b2-24ee835497b0 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.654714 Aug 05 20:04:44.687465 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 32/66] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:44 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:44.764508 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:44.807390 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8d3c3add-3d79-4dd2-a339-57861a2bef3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.228739 Aug 05 20:04:44.807390 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 35/67] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:44 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:45.358222 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:45.359213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:45.371695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:45.372428 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:45.372912 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:45.373792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:45.375000 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:45.375609 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:45.563168 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:45.576587 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:45.578216 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:45.579701 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ff29c6e1-4b56-45e2-a19e-b215dca04b04 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.227947 Aug 05 20:04:45.580298 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 33/68] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:45 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:45.711327 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:45.712073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:45.718093 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:45.718587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:45.719038 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:45.720023 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:45.720210 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:45.720827 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:45.823184 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:45.823811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:45.832836 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:45.833923 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:45.834856 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:45.835667 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:45.836825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:45.837767 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:45.867887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:45.877433 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-936cad67-35da-4674-b84c-11b5e4e2bf44 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.171445 Aug 05 20:04:45.878209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 36/69] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:45 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:46.003404 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:46.010168 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ad3ad38d-7bd8-4cd4-b49d-1507d2f41f52 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.191143 Aug 05 20:04:46.010940 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 34/70] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:45 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:46.602983 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:46.603917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:46.614886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:46.615583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:46.616193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:46.617173 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:46.617629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:46.618057 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:46.794305 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:46.803394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:46.805252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:46.806615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ffa94b19-455a-4c01-bab1-5d87cde74544 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.207569 Aug 05 20:04:46.807336 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 37/71] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:46 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:46.897830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:46.898497 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:46.905853 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:46.906421 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:46.906934 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:46.908165 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:46.908701 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:46.909354 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:47.031804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:47.033057 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:47.040736 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:47.041469 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:47.042406 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:47.043309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:47.044041 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:47.044672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:47.286773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:47.294685 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d0c79ceb-d8f5-4669-b5ac-8fcb2e9838ab tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.401564 Aug 05 20:04:47.295545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 35/72] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:46 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:47.386341 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:47.399477 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a8cbc358-fd6f-45cb-8f55-41485faa3138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.372810 Aug 05 20:04:47.402964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 38/73] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:47 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:47.832423 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:47.833122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:47.841878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:47.842370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:47.842976 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:47.843676 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:47.844355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:47.844781 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:48.316047 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:48.317171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:48.325457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:48.325956 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:48.328769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:48.332431 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:48.333155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:48.333784 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:48.510843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:48.525077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:48.531255 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:48.538195 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7bd7f268-1dee-4a37-811b-8b86fb23a732 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.709714 Aug 05 20:04:48.540498 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 36/74] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:47 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:48.547065 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:48.556880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:48.573556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:48.574272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:48.574882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:48.575744 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:48.576374 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:48.576948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:48.614716 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:48.617911 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:48.628713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-94cce070-cc1c-48ce-8fd3-89b6d9b79f7c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.316873 Aug 05 20:04:48.645200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 39/75] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:48 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:48.971105 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:48.986861 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-849f9ede-120d-42d8-8536-6c8975bb850f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.442725 Aug 05 20:04:49.010962 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 37/76] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:48 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:49.563697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:49.564335 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:49.578600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:49.580994 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:49.584285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:49.585200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:49.585792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:49.586335 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:49.650600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:49.651215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:49.653173 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:49.689977 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:49.691763 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:49.692463 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:49.693443 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:49.694354 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:49.695113 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:49.956143 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:49.967645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b00c5a24-6a5d-4878-8b2a-438d363dd11d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.319835 Aug 05 20:04:49.969965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 38/77] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:49 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:49.983365 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:49.994587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:49.996400 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:49.997729 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-da96ed2d-4466-4550-9e20-fb6275a6e99e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.438339 Aug 05 20:04:49.998533 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 40/78] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:49 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:50.020829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:50.021761 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:50.029440 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:50.029942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:50.030388 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:50.031100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:50.031554 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:50.032018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:50.194566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:50.209215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-822c2e24-bc6e-4386-92b0-da41b6d3de66 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.196972 Aug 05 20:04:50.209963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 39/79] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:50 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:50.990185 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:50.990874 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:50.992713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:50.998037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:50.998727 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:50.999172 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:51.000112 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:51.000560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:51.000994 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:51.025460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:51.026297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:51.033558 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:51.034360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:51.034868 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:51.036035 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:51.036699 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:51.037267 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:51.180208 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:51.190817 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-82f7b8d1-b733-4c8a-8475-692c76709b36 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.205112 Aug 05 20:04:51.195119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:51.200530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 41/80] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:50 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:51.204236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:51.206010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:51.208087 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cce8faf8-bb04-4a50-81e1-7d2546c69c90 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.186519 Aug 05 20:04:51.209226 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 40/81] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:51 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:04:51.235352 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:51.236601 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:51.244072 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:51.244907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:51.246525 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:51.247460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:51.248305 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:51.248944 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:51.437767 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:51.451160 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0e220eef-2e68-4158-9ab6-bb84099de49b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.224755 Aug 05 20:04:51.452709 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 42/82] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:51 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:52.212559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:52.213223 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:52.219163 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:52.219653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:52.220141 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:52.220851 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:52.221292 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:52.221722 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:52.238027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:52.239602 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:52.246955 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:52.246955 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:52.247435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:52.248163 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:52.248817 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:52.249382 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:52.406392 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:52.422235 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ad6683fb-d861-4155-9cc5-18aa91e205e9 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.213073 Aug 05 20:04:52.423226 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 41/83] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:52 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:52.449621 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:52.459742 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:52.461399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:52.462819 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-96461360-58a9-43b3-87d5-e4dc050dae92 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.233195 Aug 05 20:04:52.463415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 43/84] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:52 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:04:52.477189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:52.478149 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:52.484429 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:52.485286 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:52.485864 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:52.486823 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:52.487583 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:52.488953 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:52.667619 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:52.675467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-41f9417b-5abf-4920-9730-0553571e31d8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.202060 Aug 05 20:04:52.676748 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 42/85] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:52 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:53.447332 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:53.448627 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:53.459177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:53.460116 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:53.460834 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:53.461569 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:53.462038 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:53.462480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:53.487067 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:53.488945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:53.496023 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:53.496818 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:53.497627 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:53.498672 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:53.499320 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:53.499973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:53.629981 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:53.646013 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3cb41254-898c-4b17-9673-7b0e4727ddd1 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.204983 Aug 05 20:04:53.651324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 44/86] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:53 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:53.697850 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:53.698482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:53.705135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:53.705874 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:53.707457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:53.708490 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:53.709165 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:53.710034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:53.715946 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:53.732171 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:53.735843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:53.742326 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-393fbc38-2002-4ffe-a69e-44716b7c95bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.257409 Aug 05 20:04:53.749839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 43/87] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:53 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:53.934775 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:53.943455 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-432914b3-0c55-469a-a379-729d534f64af tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.249817 Aug 05 20:04:53.944947 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 45/88] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:53 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:54.673702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:54.674541 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:54.682621 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:54.683433 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:54.683972 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:54.684907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:54.685328 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:54.686042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:54.767419 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:54.768969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:54.780573 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:54.781429 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:54.782717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:54.783752 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:54.784464 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:54.785640 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:54.876180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:54.885231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-86391d24-9003-4992-8b35-7d2437cbc07a tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.215805 Aug 05 20:04:54.886303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 44/89] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:54 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:54.965845 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:54.966522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:54.974838 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:54.975337 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:54.980164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:54.980967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:54.981436 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:54.981874 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:54.996934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:55.007367 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:55.009407 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:55.010706 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1f3612dd-ef0b-4891-9049-d6693a7f2c34 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.248777 Aug 05 20:04:55.011940 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 46/90] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:54 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:55.152131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:55.160930 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2f04b150-9b40-445d-8c49-744929ed8a2f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.198825 Aug 05 20:04:55.161497 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 45/91] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:54 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:55.909333 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:55.910755 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:55.929155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:55.929794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:55.930346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:55.931123 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:55.931580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:55.932062 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:56.034132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:56.036061 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:56.045187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:56.045975 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:56.046718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:56.048742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:56.049395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:56.050044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:56.161839 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:56.173621 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-16ffcb5e-6641-4b7d-98fb-bdbee8ce7c82 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.269448 Aug 05 20:04:56.175310 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 47/92] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:55 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:56.186031 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:56.186918 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:56.202494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:56.203406 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:56.203580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:56.204952 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:56.205772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:56.205970 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:56.333044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:56.348295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:56.350138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:56.351463 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3621bcd8-8417-4e4e-bf95-9442c179a3d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.321981 Aug 05 20:04:56.352220 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 46/93] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:56 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:04:56.407410 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:56.416720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f741d7e0-76f2-41d9-8236-90e2d6aa3044 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.237695 Aug 05 20:04:56.432222 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 48/94] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:56 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:57.195068 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:57.195682 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:57.202817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.203309 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.204050 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.208835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.212329 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.213021 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.367295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:57.376715 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:57.377428 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:57.379600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-19c94e27-64c5-4e1f-a266-34ba4a934502 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.187707 Aug 05 20:04:57.380377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 47/95] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:57 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:57.388844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.389680 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.390322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.391463 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.392160 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.392812 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.456496 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:57.457148 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:57.464122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.464614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.465045 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.465740 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.466187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.466608 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.590616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:57.600605 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:57.605855 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:57.608425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-714ba56f-0ba0-4dca-aad6-004ec448db7f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.236746 Aug 05 20:04:57.609584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 49/96] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:57 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:57.616464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:57.629942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d11d43f2-7288-44a7-9fd9-f7356fba788b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.176439 Aug 05 20:04:57.630778 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 48/97] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:57 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:58.426979 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:58.429507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:58.439763 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.440509 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.441824 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:58.442699 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.443556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.445162 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:58.641331 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:58.642489 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:58.650981 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.652566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.653813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:58.654766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.655520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.656368 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:58.656775 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:58.669409 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8e388f3c-6762-4edb-95e8-b50ccd6a0c09 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.268014 Aug 05 20:04:58.670340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 50/98] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:58 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:58.675351 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:58.676785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:58.687913 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.689408 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.690517 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:58.693810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.696164 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.697165 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:58.740291 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:58.860245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:58.884102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:58.886851 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:58.888102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-caa395c9-836d-41ea-921e-925236d4fa83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.250936 Aug 05 20:04:58.903007 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 49/99] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:58 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:58.938967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:58.948459 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-685a2946-b59e-4c6c-8168-3b9eb0b3bb86 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.276847 Aug 05 20:04:58.949154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 51/100] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:58 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:59.270397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-3cfe01b2-a5e7-47db-a437-afbaac976296 req-0edddd07-ba78-4f81-9e70-9c0019b16a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96010245-806a-4bf6-90fb-2a70ac2a17ec", "name": "network-vif-plugged", "status": "completed", "tag": "c56b1bbe-d959-41b4-ba80-de2afa26f697"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:59.297381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-3cfe01b2-a5e7-47db-a437-afbaac976296 req-0edddd07-ba78-4f81-9e70-9c0019b16a02 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:59.299377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-3cfe01b2-a5e7-47db-a437-afbaac976296 req-0edddd07-ba78-4f81-9e70-9c0019b16a02 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:59.300115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-3cfe01b2-a5e7-47db-a437-afbaac976296 req-0edddd07-ba78-4f81-9e70-9c0019b16a02 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:59.336587 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-3cfe01b2-a5e7-47db-a437-afbaac976296 req-0edddd07-ba78-4f81-9e70-9c0019b16a02 service nova] Creating event network-vif-plugged:c56b1bbe-d959-41b4-ba80-de2afa26f697 for instance 96010245-806a-4bf6-90fb-2a70ac2a17ec on hv-cinder-85221 Aug 05 20:04:59.351724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-3cfe01b2-a5e7-47db-a437-afbaac976296 req-0edddd07-ba78-4f81-9e70-9c0019b16a02 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194409 Aug 05 20:04:59.357507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 50/101] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:59.714697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:59.715921 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:59.724521 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:59.725311 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:59.725886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:59.726817 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:59.727485 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:59.728097 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:59.875698 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:59.885663 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-35e6db75-1daa-440c-b4b3-a079be21655c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.198840 Aug 05 20:04:59.886549 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 52/102] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:59 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:59.918054 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:59.918882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:59.927636 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:59.928316 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:59.930485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:59.931516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:59.932016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:59.932488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:59.975608 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:59.976399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:59.982611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:59.983308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:59.983966 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:59.985054 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:59.985667 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:59.986409 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:00.083914 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:00.092412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:00.094024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:00.095138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c93c7ab7-fffd-44b6-a839-1b31768ea8cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.182546 Aug 05 20:05:00.095689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 51/103] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:59 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:00.129917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:00.137487 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-120dbac0-8cbd-4bf7-aeec-80caf2125377 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.166831 Aug 05 20:05:00.137993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 53/104] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:59 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:00.905950 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:00.907631 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:00.915189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:00.916150 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:00.916984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:00.918634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:00.919695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:00.920186 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:01.065823 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:01.078340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fa2441f8-785a-4761-a544-34606b3c8e45 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.176277 Aug 05 20:05:01.080284 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 52/105] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:00 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:01.118867 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:01.119682 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:01.131088 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:01.131604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:01.132067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:01.132805 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:01.133628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:01.134233 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:01.160998 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:01.161779 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:01.171600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:01.172108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:01.174637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:01.175343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:01.178533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:01.179848 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:01.305662 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:01.317196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:01.319390 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:01.320675 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-41726885-9e78-4271-aec1-c479f163cdf2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.205697 Aug 05 20:05:01.321776 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 54/106] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:01 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:01.373402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-5450da79-e800-42e3-accd-2545bf299eec req-21624f4b-256b-423a-a43c-e0ed5ceab637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49e6225-f22b-44fc-ad77-be5500dd95ca", "name": "network-vif-plugged", "status": "completed", "tag": "1bdc744a-8e2b-4857-9c57-b9ac61ab593c"}, {"server_uuid": "e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80", "name": "network-vif-plugged", "status": "completed", "tag": "4ca867f4-ff8b-46d2-bc1a-eb82e50fa8a0"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:01.385718 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-5450da79-e800-42e3-accd-2545bf299eec req-21624f4b-256b-423a-a43c-e0ed5ceab637 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:01.386439 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-5450da79-e800-42e3-accd-2545bf299eec req-21624f4b-256b-423a-a43c-e0ed5ceab637 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:01.387733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-5450da79-e800-42e3-accd-2545bf299eec req-21624f4b-256b-423a-a43c-e0ed5ceab637 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:01.402717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-5450da79-e800-42e3-accd-2545bf299eec req-21624f4b-256b-423a-a43c-e0ed5ceab637 service nova] Creating event network-vif-plugged:1bdc744a-8e2b-4857-9c57-b9ac61ab593c for instance a49e6225-f22b-44fc-ad77-be5500dd95ca on hv-cinder-85221 Aug 05 20:05:01.403102 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-5450da79-e800-42e3-accd-2545bf299eec req-21624f4b-256b-423a-a43c-e0ed5ceab637 service nova] Creating event network-vif-plugged:4ca867f4-ff8b-46d2-bc1a-eb82e50fa8a0 for instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 on hv-cinder-85221 Aug 05 20:05:01.411207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-5450da79-e800-42e3-accd-2545bf299eec req-21624f4b-256b-423a-a43c-e0ed5ceab637 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042854 Aug 05 20:05:01.412587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 55/107] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:01.455513 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:01.464849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d23a11bc-ae16-4e99-859c-43044f1249b7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1368 microversion: 2.1 time: 0.310261 Aug 05 20:05:01.465438 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 53/108] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:01 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1368 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:02.102667 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:02.103469 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:02.113362 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.116229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.116786 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.117579 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.118296 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.120148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.298111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:02.310782 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1516ee99-3987-447c-8df5-d03352ea2c34 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.212885 Aug 05 20:05:02.311364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 56/109] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:02 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:02.345893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:02.346899 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:02.359391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.360225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.363018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.366634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.367326 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.367798 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.503367 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:02.504112 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:02.521834 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.523900 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.524500 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.527453 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.528128 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.528730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.774761 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:02.779225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:02.797926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:02.799607 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:02.801342 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d7fd8796-feaf-4138-a830-5103b7dfbf12 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.459809 Aug 05 20:05:02.818707 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 54/110] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:02 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:02.962872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:02.972237 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b768bfab-a7fa-4978-a142-160c51fe65db tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1558 microversion: 2.1 time: 0.477880 Aug 05 20:05:02.973708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 57/111] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:02 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1558 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:02.995965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-70c9a8b0-1cd4-4d22-8c5f-aecad5a30503 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:02.996650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-70c9a8b0-1cd4-4d22-8c5f-aecad5a30503 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:03.008792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70c9a8b0-1cd4-4d22-8c5f-aecad5a30503 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.009697 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70c9a8b0-1cd4-4d22-8c5f-aecad5a30503 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.010283 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70c9a8b0-1cd4-4d22-8c5f-aecad5a30503 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:03.011191 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70c9a8b0-1cd4-4d22-8c5f-aecad5a30503 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.011729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70c9a8b0-1cd4-4d22-8c5f-aecad5a30503 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.012292 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70c9a8b0-1cd4-4d22-8c5f-aecad5a30503 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:03.170654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-70c9a8b0-1cd4-4d22-8c5f-aecad5a30503 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178593 Aug 05 20:05:03.171236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 55/112] 10.222.0.95 () {58 vars in 1275 bytes} [Fri Aug 5 20:05:02 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:03.333095 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:03.334521 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:03.344223 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.346229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.349861 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:03.350774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.351401 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.353569 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:03.784789 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:03.795261 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a69c690a-c0d5-4277-93b0-12f89d4e19f5 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.467000 Aug 05 20:05:03.796521 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 58/113] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:03 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:03.830823 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:03.831377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:03.841256 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.842303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.843076 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:03.844024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.845195 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.846423 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:04.094629 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:04.106839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:04.110552 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:04.112100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1fcfcdbe-c593-469a-838e-3688e07e0c15 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1408 microversion: 2.20 time: 0.289846 Aug 05 20:05:04.114350 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 56/114] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:03 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:04.820010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:04.820845 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:04.831575 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:04.833467 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:04.834469 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:04.836936 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:04.839261 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:04.839990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.139149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:05.144049 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:05.145908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:05.147567 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-73a1d76a-97f3-4283-a5d1-ce9864a5f02d tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1314 microversion: 2.1 time: 0.333663 Aug 05 20:05:05.153419 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 59/115] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:04 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:05.154910 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:05.155951 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:05.157310 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.158354 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:05.158967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:05.159550 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.417731 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:05.436636 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:05.439882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:05.443715 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e9813a2e-4459-45e0-a4b4-c479a4658ccb tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1599 microversion: 2.20 time: 0.305419 Aug 05 20:05:05.444880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 57/116] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:05 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1599 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:05.482375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9e7498b0-7353-459c-8f31-36b69d666368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:05.483336 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9e7498b0-7353-459c-8f31-36b69d666368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:05.499017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7498b0-7353-459c-8f31-36b69d666368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:05.500079 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7498b0-7353-459c-8f31-36b69d666368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:05.502006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7498b0-7353-459c-8f31-36b69d666368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.505963 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7498b0-7353-459c-8f31-36b69d666368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:05.507721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7498b0-7353-459c-8f31-36b69d666368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:05.508923 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7498b0-7353-459c-8f31-36b69d666368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.550207 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-db5ec18a-750e-4751-a060-94d909f64dcf req-8b752f48-8bbb-42b6-b5b3-66f14c5bc288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96010245-806a-4bf6-90fb-2a70ac2a17ec", "tag": "c56b1bbe-d959-41b4-ba80-de2afa26f697"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:05.587436 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-db5ec18a-750e-4751-a060-94d909f64dcf req-8b752f48-8bbb-42b6-b5b3-66f14c5bc288 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:05.587436 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-db5ec18a-750e-4751-a060-94d909f64dcf req-8b752f48-8bbb-42b6-b5b3-66f14c5bc288 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:05.587768 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-db5ec18a-750e-4751-a060-94d909f64dcf req-8b752f48-8bbb-42b6-b5b3-66f14c5bc288 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.607875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-db5ec18a-750e-4751-a060-94d909f64dcf req-8b752f48-8bbb-42b6-b5b3-66f14c5bc288 service nova] Creating event network-changed:c56b1bbe-d959-41b4-ba80-de2afa26f697 for instance 96010245-806a-4bf6-90fb-2a70ac2a17ec on hv-cinder-85221 Aug 05 20:05:05.638614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-db5ec18a-750e-4751-a060-94d909f64dcf req-8b752f48-8bbb-42b6-b5b3-66f14c5bc288 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092446 Aug 05 20:05:05.639230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 58/117] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:05.758694 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9e7498b0-7353-459c-8f31-36b69d666368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.284924 Aug 05 20:05:05.760001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 60/118] 10.222.0.95 () {60 vars in 1316 bytes} [Fri Aug 5 20:05:05 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 20:05:06.171870 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:06.172609 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:06.185343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:06.186135 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:06.186768 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:06.187753 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:06.188430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:06.189644 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:06.633701 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:06.642369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b9465c79-1390-4d67-a802-f880efd472e3 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1502 microversion: 2.1 time: 0.476712 Aug 05 20:05:06.646345 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 59/119] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:06 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1502 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:07.659318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-4bebfba3-b50c-4595-8465-624a5f900004 req-2d8108ac-dc93-493c-a996-66977c02dcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49e6225-f22b-44fc-ad77-be5500dd95ca", "tag": "1bdc744a-8e2b-4857-9c57-b9ac61ab593c"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:07.686046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4bebfba3-b50c-4595-8465-624a5f900004 req-2d8108ac-dc93-493c-a996-66977c02dcae service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:07.686046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4bebfba3-b50c-4595-8465-624a5f900004 req-2d8108ac-dc93-493c-a996-66977c02dcae service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:07.686046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4bebfba3-b50c-4595-8465-624a5f900004 req-2d8108ac-dc93-493c-a996-66977c02dcae service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:07.688231 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-4bebfba3-b50c-4595-8465-624a5f900004 req-2d8108ac-dc93-493c-a996-66977c02dcae service nova] Creating event network-changed:1bdc744a-8e2b-4857-9c57-b9ac61ab593c for instance a49e6225-f22b-44fc-ad77-be5500dd95ca on hv-cinder-85221 Aug 05 20:05:07.696288 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-4bebfba3-b50c-4595-8465-624a5f900004 req-2d8108ac-dc93-493c-a996-66977c02dcae service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042771 Aug 05 20:05:07.698310 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 61/120] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:08.545382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-344f5949-831c-445d-99f6-5960e65f006e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9667dc70-2894-42b9-878a-5e92d311852d"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:08.549695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-344f5949-831c-445d-99f6-5960e65f006e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:08.557728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-344f5949-831c-445d-99f6-5960e65f006e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:08.558441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-344f5949-831c-445d-99f6-5960e65f006e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:08.559028 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-344f5949-831c-445d-99f6-5960e65f006e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:08.560600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-344f5949-831c-445d-99f6-5960e65f006e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:08.563267 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-344f5949-831c-445d-99f6-5960e65f006e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:08.563902 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-344f5949-831c-445d-99f6-5960e65f006e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:09.317320 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-344f5949-831c-445d-99f6-5960e65f006e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "POST /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.771836 Aug 05 20:05:09.320022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 60/121] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:05:08 2022] POST /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:19.470904 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=52 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:19.471642 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=52 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:19.477815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:19.478668 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:19.486183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:19.486657 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:19.487087 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:19.487989 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:19.488473 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:19.489173 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:19.514987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:05:19.614427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5b96cd28-91c5-4446-a1d4-e13272abf37e tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "DELETE /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 204 len: 0 microversion: 2.1 time: 0.144532 Aug 05 20:05:19.615124 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 62/122] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:05:19 2022] DELETE /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:05:19.623958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=57 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:19.625693 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:19.632361 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:19.633250 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:19.642567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:19.643239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:19.643674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:19.644452 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:19.645568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:19.646183 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:19.790617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:19.799563 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-368511a8-40be-4a9d-a5e7-b0beb20aafad tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1554 microversion: 2.1 time: 0.177275 Aug 05 20:05:19.803858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 61/123] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:19 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:20.821340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:20.821947 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:20.828034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:20.828515 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:20.828945 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:20.829623 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:20.830069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:20.830497 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:20.971830 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:20.980618 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a33b5185-d746-4f84-ac1e-55a7cb232c61 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1554 microversion: 2.1 time: 0.163759 Aug 05 20:05:20.981272 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 63/124] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:20 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:22.002499 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:22.003817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:22.013124 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:22.013626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:22.014115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:22.014855 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:22.015310 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:22.016612 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:22.192059 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:22.201821 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cbe016ac-5bb8-4928-910d-1611d5cabfdf tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1554 microversion: 2.1 time: 0.203556 Aug 05 20:05:22.202590 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 62/125] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:21 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1554 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:23.241641 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:23.243662 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:23.260777 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:23.261277 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:23.261723 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:23.262435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:23.266214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:23.266662 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:23.528249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:23.546168 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-91bcf149-e0fe-461e-a1d2-fe27ed58a9cd tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1554 microversion: 2.1 time: 0.320786 Aug 05 20:05:23.546791 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 64/126] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:23 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1554 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:23.598991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-69998132-0d1f-4ea9-9115-648e66ee3b43 req-e65dfb28-04b2-460a-96c5-f1c3d6d9b452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80", "name": "network-vif-deleted", "tag": "4ca867f4-ff8b-46d2-bc1a-eb82e50fa8a0"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:23.611491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-69998132-0d1f-4ea9-9115-648e66ee3b43 req-e65dfb28-04b2-460a-96c5-f1c3d6d9b452 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:23.612290 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-69998132-0d1f-4ea9-9115-648e66ee3b43 req-e65dfb28-04b2-460a-96c5-f1c3d6d9b452 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:23.612956 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-69998132-0d1f-4ea9-9115-648e66ee3b43 req-e65dfb28-04b2-460a-96c5-f1c3d6d9b452 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:23.634080 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-69998132-0d1f-4ea9-9115-648e66ee3b43 req-e65dfb28-04b2-460a-96c5-f1c3d6d9b452 service nova] Creating event network-vif-deleted:4ca867f4-ff8b-46d2-bc1a-eb82e50fa8a0 for instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 on hv-cinder-85221 Aug 05 20:05:23.640849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-69998132-0d1f-4ea9-9115-648e66ee3b43 req-e65dfb28-04b2-460a-96c5-f1c3d6d9b452 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045933 Aug 05 20:05:23.642447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 63/127] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:24.574561 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:24.575195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:24.581584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:24.582065 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:24.583040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:24.584007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:24.584589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:24.585023 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:24.621687 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:24.622175 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:24.622613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:24.623075 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lazy-loading 'fault' on Instance uuid e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:05:24.672977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083840b9867145389ebf9cb035f0aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f205b7bd747c7b51ff51aa328a3cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:24.681627 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-16b646de-75fa-4d55-a488-ad48104df8fb tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 200 len: 1350 microversion: 2.1 time: 0.110986 Aug 05 20:05:24.682483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 65/128] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:24 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:25.704096 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:25.704951 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:25.712893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:25.713512 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:25.714199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:25.715233 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:25.715807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:25.716437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:25.734153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] HTTP exception thrown: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Request method failure captured: Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 HTTP/1.1 Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfErHtVvJbIlaJmNwLcAUK9rbO6qANglEC57rNEjS42-wf6Vj0Klh9uOxtaTXMNHPk7dUAj3rdKw_9uPudsiNmasvZuaybNa-Yt54sldBIUqwpy-SDXeT76_sdVJUWwQzx0MD1TAj4w11QaUHKruW1m6y4F_s3Q0OyZ2MzM5-y19L8 Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 2d9f205b7bd747c7b51ff51aa328a3cc Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:05:25.752414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 2d9f205b7bd747c7b51ff51aa328a3cc Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-DeleteServersTestJSON-414788039-project Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 083840b9867145389ebf9cb035f0aba1 Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-DeleteServersTestJSON-414788039-project Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.753891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80'} Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:05:25.754835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.756634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.758587 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Returning 404 to user: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:05:25.759460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d9b0c3bd-dc04-4fac-bb8d-1bff7886014c tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 404 len: 111 microversion: 2.1 time: 0.060754 Aug 05 20:05:25.763976 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 64/129] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:25 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:05:25.878551 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:25.881197 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:25.887194 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:25.887672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:25.888309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:25.889152 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:25.889755 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:25.890179 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:25.905773 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] HTTP exception thrown: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Request method failure captured: Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80/os-volume_attachments HTTP/1.1 Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfErHtVvJbIlaJmNwLcAUK9rbO6qANglEC57rNEjS42-wf6Vj0Klh9uOxtaTXMNHPk7dUAj3rdKw_9uPudsiNmasvZuaybNa-Yt54sldBIUqwpy-SDXeT76_sdVJUWwQzx0MD1TAj4w11QaUHKruW1m6y4F_s3Q0OyZ2MzM5-y19L8 Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 2d9f205b7bd747c7b51ff51aa328a3cc Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:05:25.909974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 2d9f205b7bd747c7b51ff51aa328a3cc Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-DeleteServersTestJSON-414788039-project Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 083840b9867145389ebf9cb035f0aba1 Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-DeleteServersTestJSON-414788039-project Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.911245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'server_id': 'e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80'} Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:05:25.911907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:25.913159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:25.914874 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Returning 404 to user: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:05:25.914874 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ca5f7cb0-8a2f-44a2-9e62-f0e661000a05 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037176 Aug 05 20:05:25.914874 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 66/130] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:05:25 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:05:27.146140 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:27.146791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:27.153729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:27.154228 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:27.154658 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:27.155359 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:27.155833 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:27.156305 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:27.172274 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] HTTP exception thrown: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Request method failure captured: Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 HTTP/1.1 Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfErHtVvJbIlaJmNwLcAUK9rbO6qANglEC57rNEjS42-wf6Vj0Klh9uOxtaTXMNHPk7dUAj3rdKw_9uPudsiNmasvZuaybNa-Yt54sldBIUqwpy-SDXeT76_sdVJUWwQzx0MD1TAj4w11QaUHKruW1m6y4F_s3Q0OyZ2MzM5-y19L8 Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 2d9f205b7bd747c7b51ff51aa328a3cc Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:05:27.173810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 2d9f205b7bd747c7b51ff51aa328a3cc Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-DeleteServersTestJSON-414788039-project Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 083840b9867145389ebf9cb035f0aba1 Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-DeleteServersTestJSON-414788039-project Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.175090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80'} Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:05:27.175952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.178246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.179520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Returning 404 to user: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:05:27.179520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-94c6f363-3f0a-4b7a-9b0f-d8b56fea6f41 tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "DELETE /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 404 len: 111 microversion: 2.1 time: 0.033779 Aug 05 20:05:27.179520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 65/131] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:05:27 2022] DELETE /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:05:27.187814 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:27.188977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] [instance: e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:27.195713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:27.196526 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:27.196905 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:27.197647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:27.198084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:27.198512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:27.218168 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] HTTP exception thrown: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Request method failure captured: Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 HTTP/1.1 Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfErHtVvJbIlaJmNwLcAUK9rbO6qANglEC57rNEjS42-wf6Vj0Klh9uOxtaTXMNHPk7dUAj3rdKw_9uPudsiNmasvZuaybNa-Yt54sldBIUqwpy-SDXeT76_sdVJUWwQzx0MD1TAj4w11QaUHKruW1m6y4F_s3Q0OyZ2MzM5-y19L8 Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 2d9f205b7bd747c7b51ff51aa328a3cc Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:05:27.220329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2d9f205b7bd747c7b51ff51aa328a3cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 2d9f205b7bd747c7b51ff51aa328a3cc Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-DeleteServersTestJSON-414788039 Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-DeleteServersTestJSON-414788039-project Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 083840b9867145389ebf9cb035f0aba1 Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-DeleteServersTestJSON-414788039-project Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.221743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80'} Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:05:27.226738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. Aug 05 20:05:27.227931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:27.229050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] Returning 404 to user: Instance e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:05:27.229050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-152b4523-6c18-42ad-8c44-eb1a02187ebc tempest-DeleteServersTestJSON-414788039 tempest-DeleteServersTestJSON-414788039-project] 10.222.0.95 "GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80" status: 404 len: 111 microversion: 2.1 time: 0.037750 Aug 05 20:05:27.229050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 67/132] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:27 2022] GET /compute/v2.1/servers/e49e5fd8-f9c7-4ed1-ad6b-c53bd3244b80 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:05:30.228789 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1394037425", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "networks": [{"uuid": "3e4c65cf-238e-404a-9f43-dc0e6d589b00"}]}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:30.289241 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] validate_networks() for [('3e4c65cf-238e-404a-9f43-dc0e6d589b00', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:05:30.693740 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:05:30.694508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:05:30.695215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:05:30.695688 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:05:30.696239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:05:30.710564 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:30.711162 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:30.711809 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:30.713043 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:30.713510 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:30.714097 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:30.743850 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Getting quotas for project d9667dd2533c4b2b92883a02896b1694. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:05:30.749225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Getting quotas for user f0bee31900394e1ebe82136ceeb88091 and project d9667dd2533c4b2b92883a02896b1694. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:05:30.769224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:05:30.771563 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:05:30.826820 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c6252378-809c-4772-af13-d80afb54f6ed tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603250 Aug 05 20:05:30.827533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 66/133] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:05:30.839611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1c80f5c2-13e9-4fb2-baf3-27b00e7097c3 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:30.841127 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1c80f5c2-13e9-4fb2-baf3-27b00e7097c3 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:30.974070 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1c80f5c2-13e9-4fb2-baf3-27b00e7097c3 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:30.983569 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1c80f5c2-13e9-4fb2-baf3-27b00e7097c3 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1214 microversion: 2.1 time: 0.148973 Aug 05 20:05:30.985702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 68/134] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:30 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:32.008461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:32.009111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:32.016162 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:32.016667 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:32.017107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:32.017825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:32.018286 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:32.018813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:32.091634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:32.100302 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-334aaf01-4fe1-4181-abfd-75bd05e39415 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1266 microversion: 2.1 time: 0.096230 Aug 05 20:05:32.100867 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 67/135] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:32 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:33.133427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:33.134044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:33.148224 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:33.152271 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:33.152739 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:33.153481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:33.153969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:33.154379 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:33.410272 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:33.427848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-396453a8-47c5-4467-93e8-500a0c95a383 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.294797 Aug 05 20:05:33.430483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 69/136] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:33 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:34.027727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-253d8434-976e-4c89-a2e9-292f5549422c req-d03eb227-bab8-46b3-9d40-50fd72039a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc", "tag": "5dc08258-742a-42a4-acbc-7385292347bb"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:34.044922 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-253d8434-976e-4c89-a2e9-292f5549422c req-d03eb227-bab8-46b3-9d40-50fd72039a4a service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:34.045893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-253d8434-976e-4c89-a2e9-292f5549422c req-d03eb227-bab8-46b3-9d40-50fd72039a4a service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:34.046530 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-253d8434-976e-4c89-a2e9-292f5549422c req-d03eb227-bab8-46b3-9d40-50fd72039a4a service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:34.066567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-253d8434-976e-4c89-a2e9-292f5549422c req-d03eb227-bab8-46b3-9d40-50fd72039a4a service nova] Creating event network-changed:5dc08258-742a-42a4-acbc-7385292347bb for instance 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc on hv-cinder-85221 Aug 05 20:05:34.074571 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-253d8434-976e-4c89-a2e9-292f5549422c req-d03eb227-bab8-46b3-9d40-50fd72039a4a service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052969 Aug 05 20:05:34.075817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 68/137] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:34.450745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:34.452355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:34.459482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:34.460040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:34.460851 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:34.461579 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:34.462191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:34.462625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:34.710095 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:34.718887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-65503a32-f3f5-4583-b005-a35de8b7456f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.272088 Aug 05 20:05:34.719464 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 70/138] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:34 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:35.742131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:35.743574 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:35.755584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:35.760348 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:35.760835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:35.761573 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:35.762038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:35.762464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:35.963713 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:35.972905 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-283630e4-e414-4058-9f22-779848794701 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.236466 Aug 05 20:05:35.973857 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 69/139] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:35 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:36.996278 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:36.997531 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:37.004145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:37.004898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:37.005482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:37.006813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:37.007380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:37.007923 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:37.462356 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:37.472143 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e25ffd0f-1caf-4f4d-aed2-83f3cb6b18d6 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.480556 Aug 05 20:05:37.473040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 71/140] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:36 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:38.136748 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1614098212", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:38.195944 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] validate_networks() for [('6a348301-19a8-4718-a04c-ae563d7e7361', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:05:38.494618 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:38.495230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:38.502109 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:38.502747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:38.503408 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:38.505143 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:38.506035 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:38.506704 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:38.635718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:05:38.636177 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:05:38.636673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:05:38.637286 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:05:38.637695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:05:38.648538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:38.649026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:38.649459 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:38.650180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:38.650864 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:38.651489 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:38.670976 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:38.674248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Getting quotas for project 573a75f13f7240479c725daba27011bf. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:05:38.679424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7c120585-595a-4514-905c-d9c60eb11b9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.188807 Aug 05 20:05:38.679756 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Getting quotas for user 10705004cfd74f0caddef9db51f1a52c and project 573a75f13f7240479c725daba27011bf. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:05:38.680040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 72/141] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:38 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:38.691231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:05:38.694013 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:05:38.741509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-05948fce-6370-4988-9ed9-3850d2b36e90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.755001 Aug 05 20:05:38.742147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 70/142] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:05:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:05:38.752718 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e4e5404e-b9f5-4f79-a47a-6d9d305b49af tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:38.753464 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e4e5404e-b9f5-4f79-a47a-6d9d305b49af tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:38.811014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e4e5404e-b9f5-4f79-a47a-6d9d305b49af tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:38.820086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e4e5404e-b9f5-4f79-a47a-6d9d305b49af tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1222 microversion: 2.1 time: 0.071140 Aug 05 20:05:38.820678 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 73/143] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:38 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1222 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:38.883423 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-371947888", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:38.951165 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] validate_networks() for [('6a348301-19a8-4718-a04c-ae563d7e7361', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:05:39.416354 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:05:39.418798 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:05:39.420016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:05:39.420669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:05:39.421160 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:05:39.435880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:39.436361 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:39.436817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:39.437536 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:39.437986 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:39.438473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:39.463442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Getting quotas for project 573a75f13f7240479c725daba27011bf. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:05:39.472330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Getting quotas for user 10705004cfd74f0caddef9db51f1a52c and project 573a75f13f7240479c725daba27011bf. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:05:39.492051 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:05:39.494694 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:05:39.555656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ae672ab5-097e-41a2-8c92-89971dec1612 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.679153 Aug 05 20:05:39.556986 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 71/144] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:05:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:05:39.575826 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3d4e29c0-585b-4e32-9f65-cb6c6f62ac0e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:39.577081 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3d4e29c0-585b-4e32-9f65-cb6c6f62ac0e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:39.705194 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:39.705690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3d4e29c0-585b-4e32-9f65-cb6c6f62ac0e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:39.706340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:39.714893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:39.715641 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:39.717863 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3d4e29c0-585b-4e32-9f65-cb6c6f62ac0e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1221 microversion: 2.1 time: 0.153111 Aug 05 20:05:39.718419 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:39.719419 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:39.720138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:39.720731 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:39.722681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 74/145] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:39 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:39.908196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:39.920076 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b30b5567-6ae0-4e51-bf97-5ded787f647b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.218706 Aug 05 20:05:39.922704 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 72/146] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:39 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:40.738598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:40.740079 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:40.746605 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:40.747876 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:40.748541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:40.749334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:40.749764 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:40.750261 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:40.829648 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:40.839715 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1186fad0-cfc0-4bae-a3f3-31963fba6305 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1273 microversion: 2.1 time: 0.105057 Aug 05 20:05:40.841113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 75/147] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:40 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:40.943127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:40.943881 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:40.955208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:40.955683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:40.956144 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:40.956849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:40.957296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:40.957713 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:41.058038 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-2d753780-87e1-4e2f-beb7-86f81f6c4754 req-d7bcee2a-ea38-4d26-8bbc-8368129f2c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc", "name": "network-vif-plugged", "status": "completed", "tag": "5dc08258-742a-42a4-acbc-7385292347bb"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:41.082144 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2d753780-87e1-4e2f-beb7-86f81f6c4754 req-d7bcee2a-ea38-4d26-8bbc-8368129f2c73 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:41.083294 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2d753780-87e1-4e2f-beb7-86f81f6c4754 req-d7bcee2a-ea38-4d26-8bbc-8368129f2c73 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:41.083932 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2d753780-87e1-4e2f-beb7-86f81f6c4754 req-d7bcee2a-ea38-4d26-8bbc-8368129f2c73 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:41.105392 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-2d753780-87e1-4e2f-beb7-86f81f6c4754 req-d7bcee2a-ea38-4d26-8bbc-8368129f2c73 service nova] Creating event network-vif-plugged:5dc08258-742a-42a4-acbc-7385292347bb for instance 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc on hv-cinder-85221 Aug 05 20:05:41.112308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-2d753780-87e1-4e2f-beb7-86f81f6c4754 req-d7bcee2a-ea38-4d26-8bbc-8368129f2c73 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059174 Aug 05 20:05:41.113214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 76/148] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:05:41.213920 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:41.221864 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ea033032-a1e0-484f-bc85-38d9c6f2a946 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.283114 Aug 05 20:05:41.222447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 73/149] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:40 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:41.862348 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:41.863077 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:41.884805 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:41.885312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:41.885761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:41.886514 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:41.886992 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:41.887429 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:41.980312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:41.990108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-90dc9939-f1e6-4f21-a836-7515da278947 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1279 microversion: 2.1 time: 0.130764 Aug 05 20:05:41.991658 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 77/150] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:41 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:42.253986 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:42.256896 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:42.272971 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:42.273477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:42.273919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:42.278847 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:42.279819 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:42.280831 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:42.580254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-b0253188-9f63-45c1-a22f-344e3e371de6 req-8c7960e2-8804-445a-978a-b4a211a8138c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfe824c-c06c-4210-8616-5c6f7331d1a2", "tag": "86f96b12-e991-4913-b831-de7201be0e33"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:42.592651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-b0253188-9f63-45c1-a22f-344e3e371de6 req-8c7960e2-8804-445a-978a-b4a211a8138c service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:42.593223 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-b0253188-9f63-45c1-a22f-344e3e371de6 req-8c7960e2-8804-445a-978a-b4a211a8138c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:42.593735 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-b0253188-9f63-45c1-a22f-344e3e371de6 req-8c7960e2-8804-445a-978a-b4a211a8138c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:42.604581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-b0253188-9f63-45c1-a22f-344e3e371de6 req-8c7960e2-8804-445a-978a-b4a211a8138c service nova] Creating event network-changed:86f96b12-e991-4913-b831-de7201be0e33 for instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 on hv-cinder-85221 Aug 05 20:05:42.609531 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-b0253188-9f63-45c1-a22f-344e3e371de6 req-8c7960e2-8804-445a-978a-b4a211a8138c service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034396 Aug 05 20:05:42.610128 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 78/151] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:05:42.650240 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:42.659382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-aa3141b9-3a47-4700-bea8-e9407f06283c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.417791 Aug 05 20:05:42.659976 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 74/152] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:42 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:43.013722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:43.014418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:43.024729 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:43.025316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:43.025843 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:43.026664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:43.027203 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:43.027669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:43.169788 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:43.178702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-888f6c29-095f-452c-ae67-99707a0559ac tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.169133 Aug 05 20:05:43.179617 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 79/153] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:43 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:43.688431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:43.689199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:43.696960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:43.697876 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:43.698559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:43.699391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:43.699958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:43.700457 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:43.875882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:43.884636 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4fe25353-d407-4e26-8bdf-a5530b32af9e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.207669 Aug 05 20:05:43.885241 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 75/154] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:43 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:44.200527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:44.201131 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:44.207071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:44.208131 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:44.208565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:44.209288 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:44.209732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:44.210153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:44.350956 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:44.360388 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-83c3656b-6841-4c37-ae75-10c5334c77ff tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.163667 Aug 05 20:05:44.360963 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 80/155] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:44 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:44.905659 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:44.906265 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:44.913427 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:44.913911 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:44.914345 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:44.915029 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:44.915482 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:44.915942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:45.052999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:45.060474 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-06e32da7-fa09-4f4b-b9ce-9cf277ad063b tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.158623 Aug 05 20:05:45.061035 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 76/156] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:44 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:45.381347 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:45.381882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:45.387984 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:45.388468 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:45.388901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:45.389581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:45.390030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:45.390452 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:45.529819 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:45.538524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fed01ab7-2a2b-4ca5-8adc-195009152835 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.161605 Aug 05 20:05:45.539104 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 81/157] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:45 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:46.081420 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:46.082039 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:46.088444 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:46.088942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:46.089382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:46.090088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:46.090538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:46.090973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:46.229371 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:46.236850 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e227c416-603e-49c4-8509-b8edeb9a28ee tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1314 microversion: 2.1 time: 0.159328 Aug 05 20:05:46.237411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 77/158] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:46 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:46.559414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:46.560058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:46.566097 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:46.566582 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:46.567585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:46.568590 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:46.569042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:46.569474 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:46.573650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:46.704636 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:46.713254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-93f3ea65-193c-42ac-9551-d8fef3795eca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.157677 Aug 05 20:05:46.713828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 82/159] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:46 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:47.260592 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:47.262145 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:47.268906 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:47.269385 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:47.269815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:47.271375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:47.271919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:47.272340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:47.521927 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:47.531433 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1fb4046e-f1fe-4180-8bba-1881c5613b77 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1498 microversion: 2.1 time: 0.277086 Aug 05 20:05:47.543866 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 78/160] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:47 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1498 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:47.734518 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:47.735135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:47.741355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:47.741850 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:47.742290 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:47.742990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:47.743453 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:47.743939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:47.920381 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:47.928976 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-40a18405-2daf-417e-99b1-ac978e1fdc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.198008 Aug 05 20:05:47.929748 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 83/161] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:47 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:47.950180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-2299ef9e-2898-4c07-89ca-f24fa13d1b55 req-c07f8bce-f11f-4dc1-b46e-34c4f12d2333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa307a20-721c-423c-88a3-4b3596b78533", "tag": "07d09ee9-eb0d-4e91-8ac3-af5d1f7ce9fe"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:47.962830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-2299ef9e-2898-4c07-89ca-f24fa13d1b55 req-c07f8bce-f11f-4dc1-b46e-34c4f12d2333 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:47.963316 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-2299ef9e-2898-4c07-89ca-f24fa13d1b55 req-c07f8bce-f11f-4dc1-b46e-34c4f12d2333 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:47.963956 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-2299ef9e-2898-4c07-89ca-f24fa13d1b55 req-c07f8bce-f11f-4dc1-b46e-34c4f12d2333 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:47.976585 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-2299ef9e-2898-4c07-89ca-f24fa13d1b55 req-c07f8bce-f11f-4dc1-b46e-34c4f12d2333 service nova] Creating event network-changed:07d09ee9-eb0d-4e91-8ac3-af5d1f7ce9fe for instance aa307a20-721c-423c-88a3-4b3596b78533 on hv-cinder-85221 Aug 05 20:05:47.981562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-2299ef9e-2898-4c07-89ca-f24fa13d1b55 req-c07f8bce-f11f-4dc1-b46e-34c4f12d2333 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035063 Aug 05 20:05:47.982153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 79/162] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:48.333314 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:48.334342 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:48.343312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:48.344274 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:48.345051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:48.346236 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:48.346999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:48.347735 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:48.377801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:05:48.457025 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-631195e8-2ded-45ba-85ff-be3b9f53e1d5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "DELETE /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 204 len: 0 microversion: 2.1 time: 0.129771 Aug 05 20:05:48.458346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 84/163] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:05:48 2022] DELETE /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:05:48.466979 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:48.467690 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:48.476396 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:48.476883 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:48.477318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:48.478006 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:48.478456 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:48.478877 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:48.608194 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:48.616245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-37f7d932-517d-465f-9220-7fc787372b04 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1504 microversion: 2.1 time: 0.153141 Aug 05 20:05:48.616814 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 80/164] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:48 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:48.953517 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:48.954223 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:48.961725 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:48.962218 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:48.962852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:48.963722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:48.964240 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:48.964827 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:49.112089 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:49.120560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-16b9600f-fa76-49eb-a257-e52ffd967d1a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.171281 Aug 05 20:05:49.121435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 85/165] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:48 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:49.637744 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:49.638311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:49.640361 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=6 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:49.641478 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=18 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:49.648180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:49.648670 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:49.649107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:49.649891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:49.650401 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:49.650978 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:49.669735 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=91 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:49.856071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:49.867069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-221681e8-aff7-4c86-a07b-2300159d89cd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1504 microversion: 2.1 time: 0.232899 Aug 05 20:05:49.868296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 81/166] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:49 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:50.144235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:50.144800 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:50.148130 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=6 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:50.148726 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:50.153400 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:50.153891 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:50.154336 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:50.155048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:50.155599 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:50.156136 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:50.305558 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:50.313058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f3172c50-ce70-4ad0-b193-01a4f01d7883 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.174302 Aug 05 20:05:50.313628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 86/167] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:50 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:50.890512 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:50.891180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:50.893566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:50.898973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:50.899475 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:50.899945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:50.900647 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:50.901110 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:50.901571 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:51.126494 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:51.135263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d1d02267-268c-4b17-9029-129f0f79c1b5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1504 microversion: 2.1 time: 0.248527 Aug 05 20:05:51.135848 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 82/168] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:50 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:51.335873 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:51.337090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:51.343245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:51.344037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:51.344476 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:51.345154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:51.345755 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:51.346337 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:51.490838 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:51.499735 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4708e63f-ddce-4837-8750-14b72747c64e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.168137 Aug 05 20:05:51.500957 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 87/169] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:51 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:52.157787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:52.158311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:52.166684 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:52.167737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:52.168147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:52.169231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:52.169791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:52.170322 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:52.523730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:52.524832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:52.525476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:52.531539 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:52.532152 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:52.532780 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:52.533588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:52.534038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f78f1362-7b79-40bf-8865-2f3674f11aef tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1504 microversion: 2.1 time: 0.380238 Aug 05 20:05:52.534169 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:52.534542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:52.535093 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 83/170] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:52 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:52.573756 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-be6e468f-1fbc-403d-b3ed-ffe41d05c474 req-b7b35f39-a7ee-4438-a242-b9103830fcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc", "name": "network-vif-deleted", "tag": "5dc08258-742a-42a4-acbc-7385292347bb"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:52.583017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-be6e468f-1fbc-403d-b3ed-ffe41d05c474 req-b7b35f39-a7ee-4438-a242-b9103830fcac service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:52.583605 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-be6e468f-1fbc-403d-b3ed-ffe41d05c474 req-b7b35f39-a7ee-4438-a242-b9103830fcac service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:52.583945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-be6e468f-1fbc-403d-b3ed-ffe41d05c474 req-b7b35f39-a7ee-4438-a242-b9103830fcac service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:52.597001 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-be6e468f-1fbc-403d-b3ed-ffe41d05c474 req-b7b35f39-a7ee-4438-a242-b9103830fcac service nova] Creating event network-vif-deleted:5dc08258-742a-42a4-acbc-7385292347bb for instance 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc on hv-cinder-85221 Aug 05 20:05:52.602692 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-be6e468f-1fbc-403d-b3ed-ffe41d05c474 req-b7b35f39-a7ee-4438-a242-b9103830fcac service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032497 Aug 05 20:05:52.603809 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 84/171] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:52.670475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:52.678651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-237df2ed-2893-469f-9db1-0cf560f10a1e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.159326 Aug 05 20:05:52.679216 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 88/172] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:52 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:53.557654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:53.558260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:53.564311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:53.564785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:53.565218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:53.565894 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:53.566358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:53.566766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:53.634348 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:53.642752 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d4f269eb-2ec3-46d5-8aa4-73309947155c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1462 microversion: 2.1 time: 0.089989 Aug 05 20:05:53.643343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 85/173] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:53 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:53.700430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:53.701036 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:53.706953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:53.707485 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:53.707894 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:53.708575 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:53.709057 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:53.709476 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:53.839891 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:53.847273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-01ec84ac-b4d4-411a-b6d5-eaa65d76909f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.151350 Aug 05 20:05:53.847854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 89/174] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:53 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:54.665542 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:54.667695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:54.676915 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:54.677409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:54.677843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:54.678635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:54.679166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:54.679593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:54.757444 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:54.765161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-75e3e671-93a0-4762-9e01-6e55f44e0a9c tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1462 microversion: 2.1 time: 0.104559 Aug 05 20:05:54.765718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 86/175] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:54 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1462 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:54.867690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:54.868332 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:54.874282 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:54.874767 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:54.875204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:54.875916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:54.876369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:54.876793 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:55.007967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:55.015502 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f29a0b31-07f6-40ec-a40d-fe646f2e060b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.151773 Aug 05 20:05:55.016098 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 90/176] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:54 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:55.663654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-cdeb5cd8-e28c-410c-a5ef-72831dab6f77 req-56d7132b-2919-4fbc-8d45-f90f09920160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfe824c-c06c-4210-8616-5c6f7331d1a2", "name": "network-vif-plugged", "status": "completed", "tag": "86f96b12-e991-4913-b831-de7201be0e33"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:55.673791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-cdeb5cd8-e28c-410c-a5ef-72831dab6f77 req-56d7132b-2919-4fbc-8d45-f90f09920160 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:55.674420 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-cdeb5cd8-e28c-410c-a5ef-72831dab6f77 req-56d7132b-2919-4fbc-8d45-f90f09920160 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:55.674776 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-cdeb5cd8-e28c-410c-a5ef-72831dab6f77 req-56d7132b-2919-4fbc-8d45-f90f09920160 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:55.686871 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-cdeb5cd8-e28c-410c-a5ef-72831dab6f77 req-56d7132b-2919-4fbc-8d45-f90f09920160 service nova] Creating event network-vif-plugged:86f96b12-e991-4913-b831-de7201be0e33 for instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 on hv-cinder-85221 Aug 05 20:05:55.691931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-cdeb5cd8-e28c-410c-a5ef-72831dab6f77 req-56d7132b-2919-4fbc-8d45-f90f09920160 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032762 Aug 05 20:05:55.692603 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 87/177] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:55.787414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:55.788048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:55.794312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:55.794792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:55.795219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:55.795941 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:55.796393 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:55.796813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:55.860993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:55.869053 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3fbbd17c-5485-4bac-ab52-8b9995cb7b31 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1462 microversion: 2.1 time: 0.085921 Aug 05 20:05:55.869642 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 91/178] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:55 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:56.038234 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:56.038933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:56.045600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:56.046090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:56.046528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:56.047219 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:56.047671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:56.048123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:56.178408 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:56.186052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-636849d7-dafc-4e1a-a3ff-ea0584e7a1eb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.152889 Aug 05 20:05:56.186626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 88/179] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:56 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:56.890594 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:56.891200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:56.898056 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:56.898543 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:56.898975 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:56.899661 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:56.900134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:56.900575 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:56.972535 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:56.985872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5281cc8c-6d2d-40bd-8ae8-61544dca748a tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 200 len: 1299 microversion: 2.1 time: 0.099453 Aug 05 20:05:56.986562 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 92/180] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:56 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:57.206509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:57.207125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:57.214541 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:57.215032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:57.215475 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:57.216261 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:57.216723 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:57.217151 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:57.358075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:57.370148 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a91f11c8-73c1-4c58-ba74-44a46fd2c315 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.167446 Aug 05 20:05:57.370746 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 89/181] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:57 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:58.008859 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:58.009460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:58.015332 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:58.015841 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:58.016273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:58.016952 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:58.017405 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:58.017827 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:58.032006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] HTTP exception thrown: Instance 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc could not be found. Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Request method failure captured: Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc HTTP/1.1 Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XgIR7c1m1cg0UYrewsTJJEZjq9h577su02kF-U0YQqL4n10fhPnYm5by7LN---nepIO_dJI4EZSHllbINQ_Y7cAlwdDJdpC0Nz8aaWZ0xRznOa3b2hd-q67twp-Fm0VRD3UrYlsWaCLIYmfO-USATz0tJ62LTG8dHGH9h0p_YfcQDI Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: d9667dd2533c4b2b92883a02896b1694 Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-VolumesActionsTest-973800095 Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:05:58.033702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d9667dd2533c4b2b92883a02896b1694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d9667dd2533c4b2b92883a02896b1694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d9667dd2533c4b2b92883a02896b1694"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d9667dd2533c4b2b92883a02896b1694"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-VolumesActionsTest-973800095 Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: d9667dd2533c4b2b92883a02896b1694 Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-VolumesActionsTest-973800095 Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-VolumesActionsTest-973800095-project Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: f0bee31900394e1ebe82136ceeb88091 Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-VolumesActionsTest-973800095-project Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc could not be found. Aug 05 20:05:58.035299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc'} Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc could not be found. Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:05:58.037645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc could not be found. Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc could not be found. Aug 05 20:05:58.039020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:05:58.040141 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Returning 404 to user: Instance 8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:05:58.040141 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-258b128d-8415-4e0a-aa5c-440f86b29d40 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc" status: 404 len: 111 microversion: 2.1 time: 0.030381 Aug 05 20:05:58.040141 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 93/182] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:58 2022] GET /compute/v2.1/servers/8f1d14f6-24e6-40c5-b4c3-6ddc981ec7bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:05:58.146849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-557590377", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "networks": [{"uuid": "3e4c65cf-238e-404a-9f43-dc0e6d589b00"}]}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:58.206407 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] validate_networks() for [('3e4c65cf-238e-404a-9f43-dc0e6d589b00', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:05:58.394524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:58.395629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:58.402266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:58.402984 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:58.403484 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:58.404234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:58.405099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:58.405615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:58.561584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:58.570782 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4362ca83-068e-4e0b-a112-428ab14b85df tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.180004 Aug 05 20:05:58.571369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 94/183] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:58 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:58.590536 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:05:58.590989 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:05:58.591415 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:05:58.591838 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:05:58.592246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:05:58.606980 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:58.607461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:58.607937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:58.608791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:58.609242 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:58.609753 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:58.626893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Getting quotas for project d9667dd2533c4b2b92883a02896b1694. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:05:58.633836 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Getting quotas for user f0bee31900394e1ebe82136ceeb88091 and project d9667dd2533c4b2b92883a02896b1694. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:05:58.646189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:05:58.648480 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:05:58.698935 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-460a3106-fa48-4eaf-8c0d-dc2acf78280d tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556587 Aug 05 20:05:58.699768 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 90/184] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:05:58.712545 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-934ffe9b-6f56-4f70-b610-27132b91ba3f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:58.713595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-934ffe9b-6f56-4f70-b610-27132b91ba3f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:58.788512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-934ffe9b-6f56-4f70-b610-27132b91ba3f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:58.811435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-934ffe9b-6f56-4f70-b610-27132b91ba3f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1213 microversion: 2.1 time: 0.103540 Aug 05 20:05:58.812190 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 95/185] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:58 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:59.593554 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:59.595671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:59.606418 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:59.607202 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:59.607648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:59.608483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:59.609226 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:59.609809 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:59.764163 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:59.772937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f57daa4e-0fb9-43fa-bc0d-1525ba9aa562 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.184351 Aug 05 20:05:59.773517 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 91/186] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:59 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:59.840839 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:59.841447 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:59.851156 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:59.851643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:59.852098 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:59.852802 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:59.853249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:59.853847 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:59.928350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:59.935530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3072ecb4-fb29-427e-899a-c59eca887731 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1265 microversion: 2.1 time: 0.099807 Aug 05 20:05:59.936136 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 96/187] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:59 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:00.793174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:00.794147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:00.800446 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:00.800929 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:00.801391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:00.802075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:00.802522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:00.802954 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:00.957028 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:00.958240 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:00.964615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:00.965112 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:00.965819 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:00.966541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:00.966997 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:00.967422 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:01.008022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:01.019341 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9eb4e5bd-b4af-4aaa-bacd-6158b1f9b530 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.227915 Aug 05 20:06:01.019341 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 92/188] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:00 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:01.032705 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:01.040529 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f2454c18-f35e-49ef-9cc3-26c5b90fcc97 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1271 microversion: 2.1 time: 0.087364 Aug 05 20:06:01.041110 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 97/189] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:00 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:02.038092 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:02.038731 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:02.045420 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:02.045907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:02.046345 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:02.047029 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:02.047483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:02.047952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:02.061836 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:02.062449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:02.069484 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:02.069935 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:02.070370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:02.071065 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:02.071513 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:02.071969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:02.187033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:02.196127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-dc23d2c9-beb3-4763-b379-8de70a1ab8fb tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.161805 Aug 05 20:06:02.196686 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 93/190] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:02 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:02.208055 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:02.211571 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:02.217125 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-15793ae1-0454-44b9-8b7a-425c1f271b17 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1313 microversion: 2.1 time: 0.159106 Aug 05 20:06:02.217691 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 98/191] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:02 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:03.216833 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:03.217441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:03.218890 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e2f05c41-1499-4a2c-9e92-cbfdac0321d9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:03.219382 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e2f05c41-1499-4a2c-9e92-cbfdac0321d9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:03.224515 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:03.225007 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:03.225431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:03.226124 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:03.226568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:03.226984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:03.227595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e2f05c41-1499-4a2c-9e92-cbfdac0321d9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:03.228131 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e2f05c41-1499-4a2c-9e92-cbfdac0321d9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:03.228559 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e2f05c41-1499-4a2c-9e92-cbfdac0321d9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:03.229242 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e2f05c41-1499-4a2c-9e92-cbfdac0321d9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:03.229690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e2f05c41-1499-4a2c-9e92-cbfdac0321d9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:03.230107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e2f05c41-1499-4a2c-9e92-cbfdac0321d9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:03.253472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e2f05c41-1499-4a2c-9e92-cbfdac0321d9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/ips" status: 200 len: 150 microversion: 2.20 time: 0.038634 Aug 05 20:06:03.254041 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 99/192] 10.222.0.95 () {60 vars in 1289 bytes} [Fri Aug 5 20:06:03 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 20:06:03.258505 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:03.259104 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:03.265129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:03.265728 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:03.266079 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:03.266764 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:03.269678 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:03.269678 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:03.363697 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:03.372729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f6e335a8-0288-4ccd-ba4c-241ba67d6aa8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.159609 Aug 05 20:06:03.376136 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 94/193] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:03 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:03.436060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:03.444126 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-535d928d-9cd1-468a-98c5-75d6b3e8bb27 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1313 microversion: 2.1 time: 0.189034 Aug 05 20:06:03.444702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 100/194] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:03 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:04.055147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-dd98a80d-3ee9-4ae4-be07-017449455d40 req-24f84b53-80d1-428c-a70d-00e9af45f058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab7a9a52-cd3f-4e06-bec4-d29692b1c320", "tag": "852b0dee-aec1-4565-9c13-66d4c208e5ad"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:04.062025 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-422fd273-87f0-4f02-beaa-4a5a99b5edaa req-53d22d21-d5a6-462a-92b7-041e327883f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa307a20-721c-423c-88a3-4b3596b78533", "name": "network-vif-plugged", "status": "completed", "tag": "07d09ee9-eb0d-4e91-8ac3-af5d1f7ce9fe"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:04.083183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-422fd273-87f0-4f02-beaa-4a5a99b5edaa req-53d22d21-d5a6-462a-92b7-041e327883f9 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:04.087197 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-dd98a80d-3ee9-4ae4-be07-017449455d40 req-24f84b53-80d1-428c-a70d-00e9af45f058 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:04.087875 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-422fd273-87f0-4f02-beaa-4a5a99b5edaa req-53d22d21-d5a6-462a-92b7-041e327883f9 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:04.088456 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-422fd273-87f0-4f02-beaa-4a5a99b5edaa req-53d22d21-d5a6-462a-92b7-041e327883f9 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:04.089114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-dd98a80d-3ee9-4ae4-be07-017449455d40 req-24f84b53-80d1-428c-a70d-00e9af45f058 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:04.089537 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-dd98a80d-3ee9-4ae4-be07-017449455d40 req-24f84b53-80d1-428c-a70d-00e9af45f058 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:04.110812 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-422fd273-87f0-4f02-beaa-4a5a99b5edaa req-53d22d21-d5a6-462a-92b7-041e327883f9 service nova] Creating event network-vif-plugged:07d09ee9-eb0d-4e91-8ac3-af5d1f7ce9fe for instance aa307a20-721c-423c-88a3-4b3596b78533 on hv-cinder-85221 Aug 05 20:06:04.113313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-dd98a80d-3ee9-4ae4-be07-017449455d40 req-24f84b53-80d1-428c-a70d-00e9af45f058 service nova] Creating event network-changed:852b0dee-aec1-4565-9c13-66d4c208e5ad for instance ab7a9a52-cd3f-4e06-bec4-d29692b1c320 on hv-cinder-85221 Aug 05 20:06:04.116041 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-422fd273-87f0-4f02-beaa-4a5a99b5edaa req-53d22d21-d5a6-462a-92b7-041e327883f9 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058813 Aug 05 20:06:04.116638 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 101/195] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:06:04.119230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-dd98a80d-3ee9-4ae4-be07-017449455d40 req-24f84b53-80d1-428c-a70d-00e9af45f058 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076129 Aug 05 20:06:04.120377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 95/196] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:04.393948 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:04.394666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:04.401936 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:04.402420 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:04.402856 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:04.403551 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:04.404034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:04.405009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:04.467369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:04.468103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:04.474873 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:04.475629 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:04.476392 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:04.477097 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:04.477654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:04.478087 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:04.549495 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:04.558264 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3b07dbf5-420c-4684-871c-ab4259eadfe2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.168459 Aug 05 20:06:04.558926 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 102/197] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:04 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:04.673990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:04.683331 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-da520ec2-e8ef-4a24-b85c-373a6790bedf tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1313 microversion: 2.1 time: 0.221127 Aug 05 20:06:04.684015 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 96/198] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:04 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:05.579443 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:05.580114 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:05.586776 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:05.587266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:05.587707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:05.588440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:05.588901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:05.589331 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:05.704535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:05.705281 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:05.713411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:05.713937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:05.714451 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:05.715228 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:05.715752 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:05.716353 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:05.730727 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:05.739595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-757392bf-c900-47c5-8da1-2ce98aa41a6e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.164647 Aug 05 20:06:05.752358 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 103/199] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:05 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:05.854513 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:05.864919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4bf970a3-f7ee-44f8-a789-a206e8525ac5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1313 microversion: 2.1 time: 0.164167 Aug 05 20:06:05.875266 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 97/200] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:05 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:06.760576 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:06.761216 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:06.767099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:06.767585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:06.768064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:06.768752 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:06.769205 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:06.769628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:06.886911 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:06.888356 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:06.902953 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:06.903462 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:06.903932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:06.904393 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:06.904646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:06.905101 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:06.905521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:06.918643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-013a833d-06e3-4c0c-a921-5587b72d42c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1321 microversion: 2.1 time: 0.161567 Aug 05 20:06:06.919240 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 104/201] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:06 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:07.050543 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:07.058953 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-31c5f6a7-eef7-4a82-a6d3-561456ea5e67 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1313 microversion: 2.1 time: 0.176208 Aug 05 20:06:07.059847 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 98/202] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:06 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:07.383181 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:07.383627 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:07.389852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:07.390333 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:07.390763 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:07.391597 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:07.392089 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:07.392504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:07.416819 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lazy-loading 'flavor' on Instance uuid a49e6225-f22b-44fc-ad77-be5500dd95ca {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:06:07.644511 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1737325922", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:07.673606 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6fba5b99-0fea-463b-a947-c56e2e9becb9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/action" status: 202 len: 0 microversion: 2.20 time: 0.295087 Aug 05 20:06:07.674474 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 105/203] 10.222.0.95 () {62 vars in 1319 bytes} [Fri Aug 5 20:06:07 2022] POST /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:06:07.683373 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:07.684340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:07.691874 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:07.692507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:07.693073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:07.693817 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:07.694270 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:07.694693 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:07.703641 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] validate_networks() for None {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:06:07.838143 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:07.846031 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:07.847546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:07.849631 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-aa22770f-d1f4-4491-b883-f41ff2fd9820 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.170691 Aug 05 20:06:07.850191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 106/204] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:07 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:07.940571 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:07.941308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:07.948245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:07.949071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:07.949209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:07.949866 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:07.950330 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:07.950900 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.105564 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:08.113492 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f91cf270-2e29-4477-b240-1a01a709f0ce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1516 microversion: 2.1 time: 0.176863 Aug 05 20:06:08.114617 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 107/205] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:07 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:08.119476 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:08.120115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:08.126588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.127346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.127973 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.128923 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.130508 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.131174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.287675 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:08.289111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:06:08.289546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:06:08.290053 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:06:08.290465 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:06:08.290885 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:06:08.295647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ed0939bf-4e42-4382-bef7-274049152408 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1313 microversion: 2.1 time: 0.179901 Aug 05 20:06:08.296443 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 108/206] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:08 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:08.301483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:08.304034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:08.305860 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.306541 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.306999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.307738 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.308222 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.308651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.311212 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.311909 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.312529 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.313246 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.313697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.314130 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.328912 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Getting quotas for project ced22cac760c43579905ea83f6b42ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:06:08.333561 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Getting quotas for user f916636d41e34b51a3411c5a1fece34a and project ced22cac760c43579905ea83f6b42ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:06:08.341968 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lazy-loading 'flavor' on Instance uuid aa307a20-721c-423c-88a3-4b3596b78533 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:06:08.350630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:06:08.352978 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:06:08.402210 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-28865c4c-68ad-4951-aa77-9add74287436 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761693 Aug 05 20:06:08.403039 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 99/207] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:06:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:06:08.414443 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4648e1be-aec9-4531-a9d5-511dc85cbb34 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:08.415143 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4648e1be-aec9-4531-a9d5-511dc85cbb34 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:08.452811 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1e3a90b0-02f3-485d-9829-679b4f39cbcf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533/action" status: 200 len: 32 microversion: 2.1 time: 0.154973 Aug 05 20:06:08.453522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 109/208] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:06:08 2022] POST /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:06:08.466099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:08.466906 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:08.475501 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.476159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.476977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.478290 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.479474 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.480099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.486281 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4648e1be-aec9-4531-a9d5-511dc85cbb34 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:08.495765 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4648e1be-aec9-4531-a9d5-511dc85cbb34 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1215 microversion: 2.1 time: 0.085913 Aug 05 20:06:08.496844 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 100/209] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:08 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:08.672950 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:08.684207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7adb0f13-b072-41c8-b30b-df970c283ac9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.223156 Aug 05 20:06:08.685021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 110/210] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:08 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:08.875517 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:08.876535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:08.883999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.884704 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.885325 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.886328 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.887224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.888080 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:09.122799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:09.131423 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:09.132969 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:09.134307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9131ca20-15a5-4bd2-a059-62e24701c101 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.263840 Aug 05 20:06:09.142256 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 101/211] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:08 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:09.319624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:09.320277 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:09.322401 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:09.328481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:09.329328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:09.329825 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:09.330650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:09.331184 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:09.331655 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:09.475584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:09.483542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7a3a8a5c-5ff4-4ee5-ad00-dbdf870d6958 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1313 microversion: 2.1 time: 0.167960 Aug 05 20:06:09.484174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 111/212] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:09 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:09.516526 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:09.517296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:09.524104 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:09.524593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:09.525155 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:09.525997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:09.526454 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:09.526875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:09.544238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:09.594665 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:09.602559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b55813ba-92d6-48ea-b2db-c7e0451cfd44 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1267 microversion: 2.1 time: 0.089797 Aug 05 20:06:09.603138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 102/213] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:09 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:09.706379 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:09.706986 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:09.714296 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:09.714818 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:09.715257 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:09.715987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:09.716438 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:09.716858 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:09.736410 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:09.925933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:09.933916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-62c90b9b-7a65-49de-b39b-b8ca598dfe7b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.231354 Aug 05 20:06:09.934848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 112/214] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:09 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:10.097246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-64b51986-8530-4987-9fab-b5c79ae592fe req-0cf102ae-bbe0-46ae-9671-a5b773207b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7a9a52-cd3f-4e06-bec4-d29692b1c320", "name": "network-vif-plugged", "status": "completed", "tag": "852b0dee-aec1-4565-9c13-66d4c208e5ad"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:10.109486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-64b51986-8530-4987-9fab-b5c79ae592fe req-0cf102ae-bbe0-46ae-9671-a5b773207b93 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.110301 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-64b51986-8530-4987-9fab-b5c79ae592fe req-0cf102ae-bbe0-46ae-9671-a5b773207b93 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.110963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-64b51986-8530-4987-9fab-b5c79ae592fe req-0cf102ae-bbe0-46ae-9671-a5b773207b93 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.126899 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-64b51986-8530-4987-9fab-b5c79ae592fe req-0cf102ae-bbe0-46ae-9671-a5b773207b93 service nova] Creating event network-vif-plugged:852b0dee-aec1-4565-9c13-66d4c208e5ad for instance ab7a9a52-cd3f-4e06-bec4-d29692b1c320 on hv-cinder-85221 Aug 05 20:06:10.132930 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-64b51986-8530-4987-9fab-b5c79ae592fe req-0cf102ae-bbe0-46ae-9671-a5b773207b93 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041124 Aug 05 20:06:10.134639 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 103/215] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:10.162097 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:10.162841 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:10.173768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.175407 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.175963 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.176832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.177587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.179067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.362577 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:10.375284 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:10.378692 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:10.380666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-58085a26-005e-4faa-b0b5-98727064d9a7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.225586 Aug 05 20:06:10.381585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 113/216] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:10 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:10.506387 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:10.507268 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:10.516123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.517090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.518386 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.521006 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.522374 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.523030 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.624086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:10.624698 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:10.630844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.631529 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.631993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.632688 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.633155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.633561 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.716568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:10.725882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e4c764d5-44a6-49de-861c-5f9acad43a94 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1273 microversion: 2.1 time: 0.105873 Aug 05 20:06:10.739353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 114/217] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:10 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:10.739353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6acc46bd-063c-49d8-8725-63465874406e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:10.739353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6acc46bd-063c-49d8-8725-63465874406e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:10.739353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6acc46bd-063c-49d8-8725-63465874406e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.739820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6acc46bd-063c-49d8-8725-63465874406e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.739820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6acc46bd-063c-49d8-8725-63465874406e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.739820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6acc46bd-063c-49d8-8725-63465874406e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.740278 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6acc46bd-063c-49d8-8725-63465874406e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.740787 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6acc46bd-063c-49d8-8725-63465874406e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.767853 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6acc46bd-063c-49d8-8725-63465874406e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/ips" status: 200 len: 150 microversion: 2.1 time: 0.040172 Aug 05 20:06:10.768442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 115/218] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:06:10 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:10.817424 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:10.826268 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-be7bb5d2-6624-4662-a79a-38409bde9773 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1313 microversion: 2.1 time: 0.325300 Aug 05 20:06:10.827160 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 104/219] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:10 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:10.954641 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:10.956464 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:10.963339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.964627 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.965460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.969050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.971843 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.972580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:11.204520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:11.217477 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-96b6ca57-f9bc-45b1-a4ce-51f8ad2397e9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.266699 Aug 05 20:06:11.218847 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 116/220] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:10 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:11.404441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:11.404975 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:11.411316 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:11.411719 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:11.412248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:11.412936 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:11.413446 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:11.413841 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:11.735509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:11.745482 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:11.746647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:11.747195 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:11.747753 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:11.748572 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f10cd130-2e28-4e1a-914d-4f60125eff5a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.348034 Aug 05 20:06:11.749214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 105/221] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:11 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:11.761774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:11.761774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:11.761774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:11.761774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:11.762143 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:11.762143 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:11.849665 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:11.850286 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:11.856607 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:11.857312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:11.857746 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:11.858663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:11.859115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:11.859542 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:11.904294 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:11.912541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1c6df828-68d0-47db-a26a-7b3c12a210ef tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.169752 Aug 05 20:06:11.913111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 117/222] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:11 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:12.092702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:12.102447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-48526346-37d6-4687-bb3b-ab36185f1c6e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1313 microversion: 2.1 time: 0.257538 Aug 05 20:06:12.103031 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 106/223] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:11 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:12.238307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:12.238954 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:12.239092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a2fee760-c6c4-45d8-9d27-9196198b2716 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b592256c-23e5-4112-8a38-2ce8171f34ce"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:12.242300 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a2fee760-c6c4-45d8-9d27-9196198b2716 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:12.245782 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:12.246278 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:12.246715 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:12.247430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:12.248001 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:12.248430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:12.249714 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2fee760-c6c4-45d8-9d27-9196198b2716 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:12.250292 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2fee760-c6c4-45d8-9d27-9196198b2716 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:12.251810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2fee760-c6c4-45d8-9d27-9196198b2716 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:12.252818 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2fee760-c6c4-45d8-9d27-9196198b2716 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:12.255359 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2fee760-c6c4-45d8-9d27-9196198b2716 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:12.255934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2fee760-c6c4-45d8-9d27-9196198b2716 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:12.621488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:12.630328 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-aac362c0-db42-4481-a21a-39c3caa3d3fc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.395144 Aug 05 20:06:12.631017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 107/224] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:12 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:12.749993 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-3ba9c0cb-f8f5-4303-9fe8-ae4297e64284 req-29bf26a5-b6cd-4c08-a5cc-4e1c92de80ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8170e63-1903-4b4e-b6d4-30258b686f67", "tag": "349c0bde-d319-4aed-918c-e1628a66c978"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:12.771200 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-3ba9c0cb-f8f5-4303-9fe8-ae4297e64284 req-29bf26a5-b6cd-4c08-a5cc-4e1c92de80ed service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:12.772869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-3ba9c0cb-f8f5-4303-9fe8-ae4297e64284 req-29bf26a5-b6cd-4c08-a5cc-4e1c92de80ed service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:12.773405 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-3ba9c0cb-f8f5-4303-9fe8-ae4297e64284 req-29bf26a5-b6cd-4c08-a5cc-4e1c92de80ed service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:12.790469 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-3ba9c0cb-f8f5-4303-9fe8-ae4297e64284 req-29bf26a5-b6cd-4c08-a5cc-4e1c92de80ed service nova] Creating event network-changed:349c0bde-d319-4aed-918c-e1628a66c978 for instance f8170e63-1903-4b4e-b6d4-30258b686f67 on hv-cinder-85221 Aug 05 20:06:12.797179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-3ba9c0cb-f8f5-4303-9fe8-ae4297e64284 req-29bf26a5-b6cd-4c08-a5cc-4e1c92de80ed service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054480 Aug 05 20:06:12.798214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 108/225] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:06:12.806176 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:12.806676 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:12.815155 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:12.815739 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:12.816472 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:12.818194 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:12.818996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:12.819577 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:13.019461 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a2fee760-c6c4-45d8-9d27-9196198b2716 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784666 Aug 05 20:06:13.020083 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 118/226] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:06:12 2022] POST /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:13.026075 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:13.027030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:13.033280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:13.033649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:13.034120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:13.034719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:13.035830 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:13.037088 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:13.037455 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:13.052380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:13.055196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:13.056751 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-851d901d-a260-4d32-8acf-9ca405e05da0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.256756 Aug 05 20:06:13.058016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 109/227] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:12 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:13.124886 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:13.125646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:13.132873 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:13.133368 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:13.133844 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:13.134547 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:13.135010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:13.135514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:13.213435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:13.221005 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-be0e3a19-06bb-49be-8239-d44e82ad248a tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.199817 Aug 05 20:06:13.221575 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 119/228] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:13 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:13.312547 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:13.320228 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6bf95218-9576-4459-8608-47f0c3dcc951 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1498 microversion: 2.1 time: 0.199495 Aug 05 20:06:13.320775 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 110/229] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:13 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1498 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:13.656439 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:13.656962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:13.664552 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:13.665033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:13.665466 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:13.666153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:13.666601 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:13.667030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:13.805747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:13.813801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6f694eba-344c-4269-a52f-e8ee03684083 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.161298 Aug 05 20:06:13.814361 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 120/230] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:13 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:14.081650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:14.082966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:14.089555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:14.090034 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:14.090469 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:14.091508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:14.091998 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:14.092451 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:14.226021 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:14.234009 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:14.235563 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:14.236776 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0df806f3-4750-4998-bb73-98fb5066caac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.159039 Aug 05 20:06:14.237291 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 111/231] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:14 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:14.242090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:14.242702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:14.249096 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:14.249580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:14.250017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:14.250707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:14.251171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:14.251598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:14.381342 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:14.388808 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e6c964ba-0b2e-4c90-b9d3-4a790997e518 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.150708 Aug 05 20:06:14.389404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 121/232] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:14 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:14.835674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:14.836218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:14.842125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:14.842601 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:14.843028 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:14.843706 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:14.844182 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:14.844601 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:14.984100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:14.991694 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cd508665-1ec0-49f2-aa57-85e1e0319ca3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.160669 Aug 05 20:06:14.992395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 112/233] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:14 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:15.259755 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:15.260396 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:15.266799 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:15.267282 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:15.267720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:15.268434 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:15.268886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:15.269307 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:15.399630 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:15.407516 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:15.409037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:15.410134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:15.410713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-418391d3-44a6-44fe-a11a-64d927362dc9 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.154324 Aug 05 20:06:15.410876 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:15.412846 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 122/234] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:15 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:15.417408 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:15.417899 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:15.418336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:15.419297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:15.419749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:15.420200 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:15.566811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:15.574380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5abd0847-ee0c-4c29-b846-0264bd437998 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.168074 Aug 05 20:06:15.574940 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 113/235] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:15 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:16.015179 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:16.016302 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:16.022744 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.023234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.023672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.024432 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.024888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.025315 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.158475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:16.166217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0f2fdc82-89d1-4490-8c9e-c02d9fd6a8ba tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.157163 Aug 05 20:06:16.166785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 123/236] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:16 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:16.433663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:16.434312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:16.441556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.441556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.441904 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.442784 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.443259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.443691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.594373 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:16.594987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:16.602172 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.602909 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.603349 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.604086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.604549 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.604976 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.656048 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:16.666811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:16.669518 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:16.671493 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0ca4aefa-4f1a-4b47-8f19-2226f7ecd619 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.241490 Aug 05 20:06:16.672669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 114/237] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:16 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:16.682740 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:16.683540 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:16.690521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.691263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.691928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.692705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.693184 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.693589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.721754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Going to try to terminate instance {{(pid=118174) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:06:16.808052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:16.821402 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1c09bede-14a4-411d-b2f6-56c42139f224 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "DELETE /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 204 len: 0 microversion: 2.1 time: 0.147109 Aug 05 20:06:16.821999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 115/238] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:06:16 2022] DELETE /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:06:16.830484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:16.831170 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:16.837922 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.838406 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.838840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.839576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.840085 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.840558 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.885073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:16.892334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6a044f0b-44b7-45a5-b200-3f5748ca76bc tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.301735 Aug 05 20:06:16.892898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 124/239] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:16 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:16.976820 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:16.984275 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0bc44369-f7b9-4524-aa58-889f538ab009 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1504 microversion: 2.1 time: 0.157634 Aug 05 20:06:16.984849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 116/240] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:16 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:17.187084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:17.187670 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:17.200325 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:17.200815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:17.201252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:17.201942 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:17.202392 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:17.202834 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:17.337472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:17.344883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-68636ece-0006-418f-b7d9-d3a9cf3eac88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.161749 Aug 05 20:06:17.345437 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 125/241] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:17 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:17.695931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:17.696537 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:17.702816 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:17.703289 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:17.703716 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:17.704421 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:17.704867 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:17.705286 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:17.844960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:17.853869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:17.855364 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:17.856540 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-901a725b-f718-4e58-bc6a-ea7cf0b50b20 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.165341 Aug 05 20:06:17.857094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 117/242] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:17 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:17.915105 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:17.915717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:17.922427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:17.922938 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:17.923373 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:17.924090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:17.924544 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:17.925004 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:18.005068 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:18.005731 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:18.011821 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:18.012327 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:18.012744 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:18.013435 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:18.013887 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:18.014312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:18.056235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:18.063618 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d8611838-d135-44fa-8ecc-ad7f26476004 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.152986 Aug 05 20:06:18.064211 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 126/243] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:17 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:18.151717 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:18.154089 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:18.161736 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b286b440-afbe-404e-903d-9a16323e3e64 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1504 microversion: 2.1 time: 0.160458 Aug 05 20:06:18.162327 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 118/244] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:18 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:18.364973 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:18.365634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:18.371566 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:18.372083 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:18.372524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:18.373218 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:18.373673 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:18.374098 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:18.508225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:18.515642 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d1103e0b-6d51-4dc8-9a85-9a25b4816e11 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.154546 Aug 05 20:06:18.516234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 127/245] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:18 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:18.881140 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:18.881839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:18.884175 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=4 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:18.884977 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=14 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:18.892532 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:18.893028 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:18.893464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:18.894166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:18.894624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:18.895224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:19.025225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:19.033105 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:19.034627 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:19.036061 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f86c16cb-ffbb-4c05-ad9e-9f15843c6364 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.159505 Aug 05 20:06:19.036771 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 119/246] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:18 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:19.084370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:19.084911 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:19.091297 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:19.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:19.092282 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:19.092979 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:19.093439 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:19.093871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:19.098418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:19.183251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:19.184031 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:19.190767 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:19.191253 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:19.192366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:19.193518 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:19.193973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:19.194402 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:19.229637 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:19.237497 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4c14d9b0-871a-4eaf-85ea-802fe88ca086 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.157056 Aug 05 20:06:19.239213 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 128/247] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:19 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:19.334024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:19.341964 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-45414bea-c378-40d2-8c0f-6b9756af2668 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1504 microversion: 2.1 time: 0.162535 Aug 05 20:06:19.342471 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 120/248] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:19 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:19.537708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:19.538312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:19.544544 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:19.545027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:19.545464 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:19.546149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:19.546604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:19.547031 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:19.677489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:19.684995 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4176ce9e-3e03-4651-a353-4204bcb84964 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.151628 Aug 05 20:06:19.685566 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 129/249] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:19 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:20.059113 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:20.059710 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:20.066075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.067062 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.067586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.068300 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.068746 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.069163 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.198351 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:20.206346 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:20.208735 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:20.209930 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4825438d-1205-4b8a-829d-4f14619e0972 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.154695 Aug 05 20:06:20.210488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 121/250] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:20 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:20.259515 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:20.260158 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:20.262494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=90 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:20.268036 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.268524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.268961 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.269671 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.270759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.271188 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.362949 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:20.364238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:20.370616 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.371108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.371548 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.372275 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.372731 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.373157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.408481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:20.416116 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0499c302-5619-4bf4-8b5a-76d1e15e7571 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.160397 Aug 05 20:06:20.417075 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 130/251] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:20 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:20.514115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:20.523132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-80bc6ca0-2b97-4102-8deb-786c6e3d0bea tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1504 microversion: 2.1 time: 0.163884 Aug 05 20:06:20.524215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 122/252] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:20 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:20.705961 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:20.706864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:20.713097 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.713600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.714043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.714764 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.715220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.715644 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.843645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:20.851971 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c1455558-444d-480d-9a43-74ab7dfe484f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.150173 Aug 05 20:06:20.852540 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 131/253] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:20 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:21.232650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:21.233269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:21.239986 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.240474 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.240910 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:21.241634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.242091 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.242517 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:21.382659 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:21.391533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:21.393098 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:21.394531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-99f2d963-9205-458f-abde-2909787667e4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.165841 Aug 05 20:06:21.395889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 123/254] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:21 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:21.438328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:21.438955 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:21.445898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.446397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.446839 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:21.447553 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.448028 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.448458 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:21.548296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:21.548909 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:21.555321 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.555850 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.556293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:21.557021 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.557461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.557895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:21.589398 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:21.597060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-501b9f08-3910-4562-bb3d-fd71d837f0dd tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.163748 Aug 05 20:06:21.597624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 132/255] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:21 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:21.700065 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:21.708125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-28791016-d5f2-403c-a07e-9da7a73a916e tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1504 microversion: 2.1 time: 0.162968 Aug 05 20:06:21.708687 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 124/256] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:21 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:21.873586 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:21.874088 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:21.881309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.881806 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.882252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:21.882961 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.883420 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.883926 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:22.012589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:22.019970 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b80ba7a7-5341-4062-8b18-523152901811 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.150245 Aug 05 20:06:22.020600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 133/257] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:21 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:22.419890 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:22.420495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:22.427234 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:22.427749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:22.428204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:22.428895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:22.429343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:22.429761 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:22.561826 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:22.570425 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:22.572010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:22.573162 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e7e2b08e-14c1-460a-afc7-8ed8b146ac6d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.157506 Aug 05 20:06:22.573714 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 125/258] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:22 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:22.617286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:22.617962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:22.624408 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:22.624889 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:22.625320 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:22.626009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:22.626458 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:22.626878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:22.729357 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:22.730070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:22.736071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:22.736557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:22.736990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:22.737679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:22.738132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:22.739438 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:22.759668 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:22.767828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-936bbdb3-1358-4c6c-bb2b-ca2fa1280947 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.155088 Aug 05 20:06:22.768400 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 134/259] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:22 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:22.873449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:22.881659 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-08bfca41-5053-4e77-96bc-9cef04bdcca0 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1504 microversion: 2.1 time: 0.156216 Aug 05 20:06:22.882219 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 126/260] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:22 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:23.041105 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:23.041660 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:23.047917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.048404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.048844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.049533 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.049992 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.050415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.179235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:23.188059 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e939b8e2-44a5-46f6-b79e-36f384bcc343 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.150721 Aug 05 20:06:23.188892 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 135/261] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:23 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:23.596248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:23.596862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:23.604338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.604830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.605269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.605960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.606415 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.606842 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.741772 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:23.749744 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:23.751263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:23.752476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-de7074d7-4ab7-48d3-a521-c299c6704284 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.160107 Aug 05 20:06:23.753036 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 127/262] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:23 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:23.788746 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:23.789290 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:23.796051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.796541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.796982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.797676 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.798134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.798564 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.902650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:23.903268 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:23.909224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.909727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.910145 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.913362 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.913852 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.914732 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.931925 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:23.939253 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-554bca86-77fd-4d6b-935d-52de69540b28 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.154860 Aug 05 20:06:23.939834 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 136/263] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:23 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:24.047377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:24.055926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3ae331d4-dd7d-48ac-adea-c269547cc9bd tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1504 microversion: 2.1 time: 0.157062 Aug 05 20:06:24.056507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 128/264] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:23 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:24.209173 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:24.209689 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:24.215653 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:24.216175 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:24.216622 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:24.217319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:24.217780 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:24.218211 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:24.349962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:24.357426 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0f6f045b-6cd5-4188-be3a-8c359b73bbfc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.152995 Aug 05 20:06:24.357998 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 137/265] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:24 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:24.776946 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:24.777538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:24.784712 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:24.785374 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:24.786192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:24.787075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:24.787739 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:24.788617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:24.961967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:24.962684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:24.969556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:24.970049 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:24.970483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:24.971182 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:24.971636 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:24.972088 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:24.991943 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:25.000557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:25.002247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:25.003585 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c8b0e9ea-ea90-4cf3-83d1-5fc887c63d7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.230722 Aug 05 20:06:25.004842 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 129/266] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:24 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:25.077045 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:25.077735 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:25.085550 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:25.086357 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:25.087063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:25.088587 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:25.089387 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:25.090193 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:25.113078 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:25.121778 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-959d4ebf-9473-4aba-967d-a1f92aa72a98 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.165950 Aug 05 20:06:25.122358 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 138/267] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:24 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:25.379628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:25.380274 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:25.392046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:25.392537 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:25.392968 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:25.393665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:25.394114 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:25.394535 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:25.451033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:25.459382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-883fa22f-756f-4eb9-8a52-738e3c2279f5 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1504 microversion: 2.1 time: 0.385812 Aug 05 20:06:25.460259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 130/268] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:25 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:25.567972 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:25.576259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d184259b-7ec4-49ad-8171-5ea2e3b34934 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.201350 Aug 05 20:06:25.594048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 139/269] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:25 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:25.885507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-ae4924d6-05b0-40bb-9b33-2b77a7f38d92 req-eb68e5b6-ed5d-4c50-8293-ece6bddc54ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7a9a52-cd3f-4e06-bec4-d29692b1c320", "name": "network-vif-deleted", "tag": "852b0dee-aec1-4565-9c13-66d4c208e5ad"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:25.898928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-ae4924d6-05b0-40bb-9b33-2b77a7f38d92 req-eb68e5b6-ed5d-4c50-8293-ece6bddc54ee service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:25.899624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-ae4924d6-05b0-40bb-9b33-2b77a7f38d92 req-eb68e5b6-ed5d-4c50-8293-ece6bddc54ee service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:25.900279 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-ae4924d6-05b0-40bb-9b33-2b77a7f38d92 req-eb68e5b6-ed5d-4c50-8293-ece6bddc54ee service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:25.914389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-ae4924d6-05b0-40bb-9b33-2b77a7f38d92 req-eb68e5b6-ed5d-4c50-8293-ece6bddc54ee service nova] Creating event network-vif-deleted:852b0dee-aec1-4565-9c13-66d4c208e5ad for instance ab7a9a52-cd3f-4e06-bec4-d29692b1c320 on hv-cinder-85221 Aug 05 20:06:25.920768 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-ae4924d6-05b0-40bb-9b33-2b77a7f38d92 req-eb68e5b6-ed5d-4c50-8293-ece6bddc54ee service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038379 Aug 05 20:06:25.921549 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 131/270] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:26.028403 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:26.029050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:26.036051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.036701 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.037383 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.037659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.038400 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.038829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.144470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:26.146123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:26.153248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.153825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.154231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.154937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.155394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.155883 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.187717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:26.197393 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:26.198914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:26.200382 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a443e3a5-662c-4c67-9aed-69bfdd01b4a0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.176807 Aug 05 20:06:26.200953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 140/271] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:26 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:26.309931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:26.317962 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3689f220-3780-4bd4-8956-caccba5d46f0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.177799 Aug 05 20:06:26.318468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 132/272] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:26 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:26.483016 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:26.483627 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:26.490303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.490784 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.491222 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.491950 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.492408 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.492865 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.525580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.526066 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.526505 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.526973 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lazy-loading 'fault' on Instance uuid ab7a9a52-cd3f-4e06-bec4-d29692b1c320 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:06:26.579017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0bee31900394e1ebe82136ceeb88091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9667dd2533c4b2b92883a02896b1694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:26.586712 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0eb014c1-0166-4d77-bd27-b2196568a637 tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 200 len: 1303 microversion: 2.1 time: 0.107573 Aug 05 20:06:26.587283 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 141/273] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:26 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:26.597535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:26.598581 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:26.604570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.605049 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.605478 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.606162 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.606610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.607027 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.750765 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:26.759552 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e309e4dd-9013-44e7-9807-5842f96f6ca6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.166220 Aug 05 20:06:26.760157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 133/274] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:26 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:26.982251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-834cf052-434c-4219-929d-fefac77a2d1a req-eb8c547f-2a2f-4a8b-9bce-a98b0995cfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8170e63-1903-4b4e-b6d4-30258b686f67", "name": "network-vif-plugged", "status": "completed", "tag": "349c0bde-d319-4aed-918c-e1628a66c978"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:26.993138 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-834cf052-434c-4219-929d-fefac77a2d1a req-eb8c547f-2a2f-4a8b-9bce-a98b0995cfb9 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.993628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-834cf052-434c-4219-929d-fefac77a2d1a req-eb8c547f-2a2f-4a8b-9bce-a98b0995cfb9 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.994234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-834cf052-434c-4219-929d-fefac77a2d1a req-eb8c547f-2a2f-4a8b-9bce-a98b0995cfb9 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.006415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-834cf052-434c-4219-929d-fefac77a2d1a req-eb8c547f-2a2f-4a8b-9bce-a98b0995cfb9 service nova] Creating event network-vif-plugged:349c0bde-d319-4aed-918c-e1628a66c978 for instance f8170e63-1903-4b4e-b6d4-30258b686f67 on hv-cinder-85221 Aug 05 20:06:27.011454 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-834cf052-434c-4219-929d-fefac77a2d1a req-eb8c547f-2a2f-4a8b-9bce-a98b0995cfb9 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033383 Aug 05 20:06:27.012250 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 142/275] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:27.225868 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:27.226474 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:27.233035 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.233551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.233982 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.234932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.235391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.235902 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.339544 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:27.340267 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:27.346306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.346792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.347222 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.348062 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.348469 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.348894 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.394671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:27.403808 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:27.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:27.406532 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-61ed2de9-c617-4195-aaa4-9121f497f309 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.184872 Aug 05 20:06:27.407082 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 134/276] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:27 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:27.482350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:27.490781 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a01f6cd8-b7b5-44f6-aeda-99a40d012ec0 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.155868 Aug 05 20:06:27.491352 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 143/277] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:27 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:27.607645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:27.608280 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] [instance: ab7a9a52-cd3f-4e06-bec4-d29692b1c320] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:27.614948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.615425 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.616035 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.616721 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.617175 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.617747 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.631393 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] HTTP exception thrown: Instance ab7a9a52-cd3f-4e06-bec4-d29692b1c320 could not be found. Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Request method failure captured: Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 HTTP/1.1 Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XgIR7c1m1cg0UYrewsTJJEZjq9h577su02kF-U0YQqL4n10fhPnYm5by7LN---nepIO_dJI4EZSHllbINQ_Y7cAlwdDJdpC0Nz8aaWZ0xRznOa3b2hd-q67twp-Fm0VRD3UrYlsWaCLIYmfO-USATz0tJ62LTG8dHGH9h0p_YfcQDI Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: d9667dd2533c4b2b92883a02896b1694 Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-VolumesActionsTest-973800095 Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:06:27.633026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d9667dd2533c4b2b92883a02896b1694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d9667dd2533c4b2b92883a02896b1694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d9667dd2533c4b2b92883a02896b1694"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d9667dd2533c4b2b92883a02896b1694"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-VolumesActionsTest-973800095 Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: d9667dd2533c4b2b92883a02896b1694 Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-VolumesActionsTest-973800095 Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-VolumesActionsTest-973800095-project Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: f0bee31900394e1ebe82136ceeb88091 Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-VolumesActionsTest-973800095-project Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance ab7a9a52-cd3f-4e06-bec4-d29692b1c320 could not be found. Aug 05 20:06:27.634586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'ab7a9a52-cd3f-4e06-bec4-d29692b1c320'} Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab7a9a52-cd3f-4e06-bec4-d29692b1c320 could not be found. Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:06:27.635430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab7a9a52-cd3f-4e06-bec4-d29692b1c320 could not be found. Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab7a9a52-cd3f-4e06-bec4-d29692b1c320 could not be found. Aug 05 20:06:27.636921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:27.638164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] Returning 404 to user: Instance ab7a9a52-cd3f-4e06-bec4-d29692b1c320 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:06:27.638164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-af9aebe5-6c28-48a4-a9be-e1638a02934f tempest-VolumesActionsTest-973800095 tempest-VolumesActionsTest-973800095-project] 10.222.0.95 "GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320" status: 404 len: 111 microversion: 2.1 time: 0.030710 Aug 05 20:06:27.638164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 135/278] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:27 2022] GET /compute/v2.1/servers/ab7a9a52-cd3f-4e06-bec4-d29692b1c320 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:06:27.781007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:27.781613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:27.791767 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.792308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.792747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.793690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.794429 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.795091 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.931911 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:27.940037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b2437833-3a97-487a-94c5-f5331a0d8064 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.162966 Aug 05 20:06:27.940803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 144/279] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:27 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:28.429613 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:28.430637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:28.436741 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:28.437232 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:28.437677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:28.438377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:28.438834 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:28.439264 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:28.515097 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:28.515649 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:28.524246 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:28.524739 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:28.525180 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:28.525875 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:28.526333 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:28.526758 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:28.531171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:28.572614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:28.574871 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:28.582889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:28.584732 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:28.585973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-726c8f82-699b-441f-98f3-fa2dce346bb3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.160442 Aug 05 20:06:28.586531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 136/280] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:28 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:28.675750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:28.685400 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f5ffb7d9-539c-4028-b2d6-8cd7d741747c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.173634 Aug 05 20:06:28.686101 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 145/281] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:28 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:28.966079 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:28.966685 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:28.973615 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:28.974096 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:28.974531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:28.975224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:28.975681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:28.976234 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:29.246118 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:29.253444 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-85c9a251-9a56-4a96-ad45-b20015612b7e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.291217 Aug 05 20:06:29.254010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 137/282] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:28 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:29.609118 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:29.609638 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:29.616451 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:29.616936 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:29.617371 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:29.618064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:29.618517 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:29.618943 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:29.706488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:29.707631 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:29.720111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:29.720604 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:29.721040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:29.721806 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:29.722259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:29.723374 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:29.769328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:29.777964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:29.779480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:29.780662 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-09500686-c05d-4f4d-bac0-829fa3eaf16f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.175612 Aug 05 20:06:29.781224 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 146/283] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:29 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:29.856256 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:29.863706 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fbeb7376-7a68-41e7-bc37-dd64532a4615 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.161077 Aug 05 20:06:29.864204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 138/284] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:29 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:30.273899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:30.274560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:30.280605 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:30.281088 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:30.281527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:30.282217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:30.282672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:30.283098 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:30.422965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:30.433225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5cb88cd7-5bce-4f0c-b183-b3914310edb5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.162935 Aug 05 20:06:30.435161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 147/285] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:30 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:30.807556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:30.808197 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:30.814724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:30.815208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:30.815640 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:30.816366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:30.816874 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:30.817299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:30.884311 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:30.884925 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:30.891230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:30.891719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:30.892228 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:30.892919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:30.893381 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:30.893809 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:30.950966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:30.959640 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:30.961264 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:30.962529 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d052882c-1447-4d92-8514-abd75c99b254 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.158920 Aug 05 20:06:30.963156 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 139/286] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:30 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:31.027275 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:31.034757 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a7fd5da4-0ee3-4a16-baa4-a05eb095bf18 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1315 microversion: 2.1 time: 0.154292 Aug 05 20:06:31.036133 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 148/287] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:30 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:31.455577 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:31.456220 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:31.463069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:31.463558 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:31.464017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:31.464704 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:31.465150 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:31.465570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:31.597282 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:31.604920 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b3df79ad-c0e7-49d5-9dbe-29eabdda079d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.153290 Aug 05 20:06:31.605477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 140/288] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:31 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:31.986468 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:31.987058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:31.996958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:31.997450 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:31.997888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:31.998585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:31.999041 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:31.999469 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.057166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:32.057773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:32.064124 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.064806 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.065242 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.065932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.066409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.066843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.130049 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:32.138213 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:32.139748 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:32.140946 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-575cccc4-814a-471c-96c4-1d985c1994ac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.158503 Aug 05 20:06:32.141504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 149/289] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:31 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:32.201506 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:32.209869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e098cf63-1821-45f9-812f-7452e8664ca1 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1464 microversion: 2.1 time: 0.156556 Aug 05 20:06:32.210434 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 141/290] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:32 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:32.257186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:32.257713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:32.263766 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.264286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.264724 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.265412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.265870 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.266297 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.291460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:06:32.365431 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b3647c8e-9949-4432-946b-08b8c42c10ec tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "DELETE /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 204 len: 0 microversion: 2.1 time: 0.112471 Aug 05 20:06:32.366012 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 150/291] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:06:32 2022] DELETE /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:06:32.374515 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:32.375121 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:32.382437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.382973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.383447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.384304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.384758 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.385181 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.519917 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:32.527407 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cdcd769a-d9d2-4b8f-a9fb-a273df5f1c7d tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1470 microversion: 2.1 time: 0.156839 Aug 05 20:06:32.527990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 142/292] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:32 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:32.626498 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:32.627203 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:32.633978 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.634510 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.634951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.635641 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.636134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.636561 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.770592 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:32.778359 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e0282647-7b0c-4066-aa72-212123c49d90 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.156211 Aug 05 20:06:32.791360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 151/293] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:32 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:33.164114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:33.164676 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:33.171270 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:33.171760 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:33.172214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:33.172899 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:33.173356 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:33.173774 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:33.308411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:33.316351 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:33.318743 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:33.319957 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-497545d1-89d6-403f-b1e3-822658bed6f7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.160077 Aug 05 20:06:33.320536 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 143/294] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:33 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:33.548170 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:33.548786 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:33.556108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:33.556598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:33.557038 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:33.557742 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:33.558205 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:33.558634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:33.697474 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:33.704939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f52cf70b-8ac4-4463-9b70-6017e14207a9 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1470 microversion: 2.1 time: 0.160553 Aug 05 20:06:33.705508 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 152/295] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:33 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:33.798742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:33.799351 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:33.806703 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:33.807276 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:33.807719 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:33.808456 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:33.809029 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:33.809464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:33.966853 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:33.977931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-90bdb44e-b8f1-46e4-9b15-637b1988814f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.182629 Aug 05 20:06:33.979031 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 144/296] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:33 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:34.343020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:34.344069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:34.353900 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:34.354646 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:34.355333 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:34.356412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:34.357081 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:34.357588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:34.569262 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:34.577744 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:34.579421 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:34.580564 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-435258d7-6c35-4879-8a2f-dfdd48631bde tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.241437 Aug 05 20:06:34.581150 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 153/297] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:34 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:34.732128 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:34.732772 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:34.745337 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:34.746223 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:34.748347 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:34.749409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:34.751647 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:34.755180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:34.986659 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:34.996037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f29f236d-7b29-419b-b9cf-31c2ca8e3329 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1470 microversion: 2.1 time: 0.268015 Aug 05 20:06:34.997437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 145/298] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:34 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:35.005595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:35.006619 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:35.014151 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:35.015119 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:35.015731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:35.016844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:35.017490 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:35.021260 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:35.258220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:35.269523 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3bbaec51-141a-462b-a893-8443ab71cdad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.268522 Aug 05 20:06:35.270819 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 154/299] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:34 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:35.604024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:35.604834 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:35.619652 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:35.620403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:35.621110 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:35.622057 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:35.622584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:35.623080 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:35.819674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:35.847582 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:35.855827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:35.857740 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1f0c3817-3202-4312-96b3-6b3211a7aa8b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1744 microversion: 2.20 time: 0.257679 Aug 05 20:06:35.860886 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 146/300] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:35 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1744 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:36.018391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:36.019345 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:36.034684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:36.035192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:36.036434 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:36.039500 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:36.040015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:36.042150 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:36.291826 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:36.293095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:36.323912 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:36.324544 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:36.327566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:36.329338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:36.329855 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:36.330224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:36.612863 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:36.623345 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ea4faaf2-eae4-4b34-9ecd-3ce086203d25 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1470 microversion: 2.1 time: 0.608881 Aug 05 20:06:36.624854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 155/301] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:36 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1470 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:36.671969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4034e6d1-f482-4111-b762-74cc5e2b117c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: .version_select at 0x7f5691eabca0>, body: {"keypair": {"name": "tempest-keypair-879832536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABrhp12+uwUM4WCiHSVIeqLVbZpkr/BpHdjG5yURGcB9g609VX7o+Tj+JHZOE8LpY7q6EktmzTLewJhcNfEq1F7RK+KNJMKYHFMkAB8INXivNfciSr/xU1eFhjfrmDYRg=="}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:36.696741 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-4034e6d1-f482-4111-b762-74cc5e2b117c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for project 43323ff64b8843639e0428c69d5c71c1. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:06:36.702203 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-4034e6d1-f482-4111-b762-74cc5e2b117c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for user 67e79817ed9e40728f92a22053a24118 and project 43323ff64b8843639e0428c69d5c71c1. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:06:36.735643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4034e6d1-f482-4111-b762-74cc5e2b117c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068022 Aug 05 20:06:36.737115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 156/302] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:06:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:06:36.887692 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:36.889222 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:36.900265 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:36.901733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:36.902669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:36.904322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:36.905022 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:36.905726 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:37.170790 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:37.181279 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:37.188184 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:37.190738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ce918e68-91c6-414f-92c6-4940f2c94325 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1744 microversion: 2.20 time: 0.308402 Aug 05 20:06:37.197811 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 157/303] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:36 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1744 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:37.214000 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:37.221995 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-571c7514-a6ba-4ddc-9974-e7f6e0402b68 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.934345 Aug 05 20:06:37.228145 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 147/304] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:36 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:37.647657 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:37.648550 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:37.663077 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:37.664505 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:37.665170 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:37.666729 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:37.667604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:37.668219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:37.795661 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:37.814584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-89f921d3-1d5c-4853-acb2-f676173ee88c tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1428 microversion: 2.1 time: 0.172324 Aug 05 20:06:37.820656 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 158/305] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:37 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1428 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:37.917059 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-ebbf92c4-37e1-40b4-97b0-812f15e16b28 req-0be8e9ef-dbb7-4e62-90d1-ef280ebe7152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8170e63-1903-4b4e-b6d4-30258b686f67", "name": "network-vif-deleted", "tag": "349c0bde-d319-4aed-918c-e1628a66c978"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:37.950240 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-ebbf92c4-37e1-40b4-97b0-812f15e16b28 req-0be8e9ef-dbb7-4e62-90d1-ef280ebe7152 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:37.950958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-ebbf92c4-37e1-40b4-97b0-812f15e16b28 req-0be8e9ef-dbb7-4e62-90d1-ef280ebe7152 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:37.951823 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-ebbf92c4-37e1-40b4-97b0-812f15e16b28 req-0be8e9ef-dbb7-4e62-90d1-ef280ebe7152 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:37.978479 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-ebbf92c4-37e1-40b4-97b0-812f15e16b28 req-0be8e9ef-dbb7-4e62-90d1-ef280ebe7152 service nova] Creating event network-vif-deleted:349c0bde-d319-4aed-918c-e1628a66c978 for instance f8170e63-1903-4b4e-b6d4-30258b686f67 on hv-cinder-85221 Aug 05 20:06:37.986894 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-ebbf92c4-37e1-40b4-97b0-812f15e16b28 req-0be8e9ef-dbb7-4e62-90d1-ef280ebe7152 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076438 Aug 05 20:06:37.987751 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 148/306] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:38.190042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-9680e4fd-b152-4f9d-b7f1-a6a854135fed req-d043e230-8f2c-41d2-a982-853362de6825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49e6225-f22b-44fc-ad77-be5500dd95ca", "name": "network-vif-plugged", "status": "completed", "tag": "1bdc744a-8e2b-4857-9c57-b9ac61ab593c"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:38.211566 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-9680e4fd-b152-4f9d-b7f1-a6a854135fed req-d043e230-8f2c-41d2-a982-853362de6825 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.213250 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-9680e4fd-b152-4f9d-b7f1-a6a854135fed req-d043e230-8f2c-41d2-a982-853362de6825 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.213951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-9680e4fd-b152-4f9d-b7f1-a6a854135fed req-d043e230-8f2c-41d2-a982-853362de6825 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.229262 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:38.231225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:38.247905 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.248427 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.252215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.257061 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.259017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.259705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.263469 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-9680e4fd-b152-4f9d-b7f1-a6a854135fed req-d043e230-8f2c-41d2-a982-853362de6825 service nova] Creating event network-vif-plugged:1bdc744a-8e2b-4857-9c57-b9ac61ab593c for instance a49e6225-f22b-44fc-ad77-be5500dd95ca on hv-cinder-85221 Aug 05 20:06:38.283346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-9680e4fd-b152-4f9d-b7f1-a6a854135fed req-d043e230-8f2c-41d2-a982-853362de6825 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097370 Aug 05 20:06:38.287233 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 159/307] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:06:38.304750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:38.307044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:38.329129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.331408 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.332979 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.338338 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.339017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.343237 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.622071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:38.636859 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:38.638535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:38.644382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-55b7e8f2-3731-4ba3-bb66-8160fe0ac088 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1744 microversion: 2.20 time: 0.417408 Aug 05 20:06:38.647201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 149/308] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:38 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1744 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:38.729739 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:38.746379 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d83df623-93b4-4ddb-afae-b29c13926fed tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.455566 Aug 05 20:06:38.748460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 160/309] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:38 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:38.856623 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:38.858758 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:38.886156 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.886702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.889717 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.897384 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.898687 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.899808 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:39.009800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:39.010196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:39.032106 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:39.039878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lazy-loading 'fault' on Instance uuid f8170e63-1903-4b4e-b6d4-30258b686f67 {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:06:39.221970 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916636d41e34b51a3411c5a1fece34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced22cac760c43579905ea83f6b42ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:39.255433 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-50a27c99-abf8-402c-a7d8-6cd94ba799de tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 200 len: 1305 microversion: 2.1 time: 0.415601 Aug 05 20:06:39.256997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 150/310] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:38 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 1305 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:39.671411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:39.672722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1325950565", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e6eb1b0-c7d1-48fb-bae8-24a190109c29"}], "security_groups": [{"name": "tempest-securitygroup--63879143"}], "key_name": "tempest-keypair-879832536", "user_data": "}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:39.674179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:39.691250 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:39.692661 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:39.694329 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:39.695165 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:39.695634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:39.699033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:40.040413 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:40.053961 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:40.055514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:40.057084 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-37cbcca6-e2a9-4ce4-80a7-5e78e861cf7e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.390397 Aug 05 20:06:40.057783 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 151/311] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:39 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:40.110507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:40.111384 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:40.118207 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:40.119029 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:40.124477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:40.125485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:40.126400 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:40.127066 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:40.478848 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:40.497736 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-aa6fa7af-a628-4735-92c9-5cf20a8cf6a8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.401635 Aug 05 20:06:40.498912 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 152/312] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:40 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:40.509810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:40.512716 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] [instance: f8170e63-1903-4b4e-b6d4-30258b686f67] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:40.526653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:40.528980 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:40.529591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:40.530497 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:40.531516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:40.532284 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:40.555036 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] HTTP exception thrown: Instance f8170e63-1903-4b4e-b6d4-30258b686f67 could not be found. Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Request method failure captured: Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 HTTP/1.1 Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XgugbKRBNvjLdZNOMi2W3byDF8HBV4_UewqdpZ7T-qqq9Y9EJTzqhi4JeL0dN_C1ZnwLKO8ubfGBb_mM7HkFtwbhaT4mqdPS2vwH_j-JkMnWt6XCP36yrXHWAC0qbrdQc0a3tVDcHcBwPA3Sr9AMShcYWVA_olfM48V6UVPZEQpq_k Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: ced22cac760c43579905ea83f6b42ee3 Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-VolumesNegativeTest-639827027 Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:06:40.559680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/ced22cac760c43579905ea83f6b42ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_ced22cac760c43579905ea83f6b42ee3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/ced22cac760c43579905ea83f6b42ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/ced22cac760c43579905ea83f6b42ee3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-VolumesNegativeTest-639827027 Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: ced22cac760c43579905ea83f6b42ee3 Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-VolumesNegativeTest-639827027 Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-VolumesNegativeTest-639827027-project Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: f916636d41e34b51a3411c5a1fece34a Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-VolumesNegativeTest-639827027-project Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance f8170e63-1903-4b4e-b6d4-30258b686f67 could not be found. Aug 05 20:06:40.561248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'f8170e63-1903-4b4e-b6d4-30258b686f67'} Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8170e63-1903-4b4e-b6d4-30258b686f67 could not be found. Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:06:40.562157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8170e63-1903-4b4e-b6d4-30258b686f67 could not be found. Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8170e63-1903-4b4e-b6d4-30258b686f67 could not be found. Aug 05 20:06:40.563367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:06:40.571640 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] Returning 404 to user: Instance f8170e63-1903-4b4e-b6d4-30258b686f67 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:06:40.572997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-eaa3c1b8-2fa2-46c9-b650-cb6ac4b21b01 tempest-VolumesNegativeTest-639827027 tempest-VolumesNegativeTest-639827027-project] 10.222.0.95 "GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67" status: 404 len: 111 microversion: 2.1 time: 0.073006 Aug 05 20:06:40.573710 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 153/313] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:40 2022] GET /compute/v2.1/servers/f8170e63-1903-4b4e-b6d4-30258b686f67 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:06:41.115969 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:41.116727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:41.128530 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:41.129656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:41.132254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:41.133045 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:41.133511 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:41.133943 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:41.224903 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:41.694777 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:41.710074 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:41.714205 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:41.715446 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-35c0ba3b-c446-4e81-bdd5-e104abcd87b7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.626986 Aug 05 20:06:41.731742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 154/314] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:41 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:41.731742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:41.731742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:41.737710 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:41.738210 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:41.739678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:41.740435 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:41.740779 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:41.741235 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:42.056538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:42.066550 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5b49a03f-ce33-4727-b986-ec82dbc167f2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.349102 Aug 05 20:06:42.071302 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 155/315] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:41 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:42.743232 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:42.744992 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:42.755840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:42.756586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:42.757203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:42.758107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:42.758728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:42.759309 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:43.650467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:43.669577 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:43.673083 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:43.677357 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d1c7a4bd-25c1-4f0d-bbc3-5578f10f51cd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.937958 Aug 05 20:06:43.681874 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 156/316] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:42 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:43.720239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:43.721326 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:43.746137 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:43.750347 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:43.757521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:43.758968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:43.761332 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:43.761945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:44.056721 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:44.065708 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-902f952f-eb25-46c4-acae-fab4fcee61e5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.381293 Aug 05 20:06:44.071583 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 157/317] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:43 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:44.711969 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:44.712609 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:44.733712 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:44.734786 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:44.738247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:44.757677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:44.758339 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:44.758798 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:45.098102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:45.109281 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:45.110914 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:45.112564 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a749b6e7-39ed-499c-b14d-4aa1aa393d44 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.406833 Aug 05 20:06:45.114610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 158/318] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:44 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:45.128497 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:45.130273 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:45.139122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:45.139664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:45.140189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:45.145673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:45.146488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:45.146792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:45.617431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:45.629263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-aadf9840-fc34-4a79-812b-912839ee3ccc tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.508468 Aug 05 20:06:45.629811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 159/319] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:45 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:46.148318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:46.152614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:46.183040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:46.183553 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:46.184027 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:46.188071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:46.191134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:46.192304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:46.523585 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:46.544806 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:46.547287 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:46.549473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1e6e19d1-8a82-448e-a78b-4769a98994ce tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.410969 Aug 05 20:06:46.550309 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 160/320] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:46 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:46.651932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:46.652809 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:46.664253 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:46.670853 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:46.671665 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:46.673565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:46.677675 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:46.682995 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:46.711944 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=4 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:47.001628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:47.011550 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-35d5bf1f-17eb-4fd1-a123-95de3f2d5858 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.364475 Aug 05 20:06:47.024695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 161/321] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:46 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:47.574646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:47.576102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:47.579146 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:47.589538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:47.590545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:47.591358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:47.592402 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:47.593179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:47.594861 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:47.896205 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:47.912670 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:47.929248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:47.935094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-da21f952-fe0b-406e-b92a-3ad17816ce67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.360980 Aug 05 20:06:47.937322 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 162/322] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:47 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:48.036721 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:48.037580 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:48.072828 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:48.077898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:48.082865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:48.091519 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:48.093747 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:48.094790 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:48.512105 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:48.519293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-adaeb880-e033-4575-8300-b4caa3dfb3ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.488353 Aug 05 20:06:48.523345 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 163/323] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:48 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:48.742814 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:48.965176 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:48.966576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:48.977453 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:48.989105 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:48.994570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:49.004402 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:49.013115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:49.026878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:49.557897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:49.568863 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:49.570228 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:49.571557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0033efd8-a74d-4c48-b4e8-87497ee4aa13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.611126 Aug 05 20:06:49.587926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 164/324] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:48 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:49.587926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:49.587926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:49.598156 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:49.599600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:49.600103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:49.600851 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:49.601628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:49.602071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:49.705108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:49.991966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:50.011460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1592a68f-afa2-466a-801b-30c0543fe7c2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.429866 Aug 05 20:06:50.012551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 165/325] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:49 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:50.603133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:50.604386 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:50.635479 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:50.643640 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:50.644348 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:50.647541 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:50.653725 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:50.654466 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:51.103836 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:51.120195 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:51.125849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:51.127416 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cce6722b-d0f8-4592-b3a5-1d5e8974d103 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.535502 Aug 05 20:06:51.131242 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 166/326] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:50 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:51.159835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:51.163536 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:51.173517 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:51.174444 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:51.175148 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:51.177087 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:51.177922 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:51.178663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:51.565962 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:51.578868 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5aad7de4-d9d7-4a87-92c1-c93273cd3c43 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.446296 Aug 05 20:06:51.596821 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 167/327] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:51 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:52.164718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:52.166794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:52.192624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:52.194068 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:52.195991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:52.198773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:52.200911 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:52.203556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:52.686369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:52.703346 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:52.714002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:52.715527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cf102ece-1798-41d9-a514-7df806b1ebcc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.556702 Aug 05 20:06:52.737102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 168/328] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:52 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:52.746529 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:52.752647 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:52.764635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:52.767358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:52.767955 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:52.772707 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:52.773340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:52.773892 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:53.032180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:53.045334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7e336c5d-7353-417a-aed9-2719038b1d63 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.306836 Aug 05 20:06:53.054754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 169/329] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:52 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:53.743273 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:53.744936 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:53.757347 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:53.758200 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:53.758807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:53.765819 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:53.766566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:53.771380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:54.296283 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:54.314180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:54.324859 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:54.326656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-38364ed6-83f0-4b9f-a97f-a1fb0246a84d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.587812 Aug 05 20:06:54.335521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 170/330] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:53 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:54.342895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:54.343821 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:54.369005 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:54.372141 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:54.372844 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:54.375462 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:54.376297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:54.379311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:54.383021 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:54.904956 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:54.920018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5d500c03-f05c-47a8-99bb-424d568b0837 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.582427 Aug 05 20:06:54.933380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 171/331] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:54 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:55.360810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:55.361898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:55.380350 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:55.382628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:55.383506 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:55.384531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:55.387584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:55.388319 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:55.748017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:55.766268 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:55.777811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:55.779734 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a151f2c4-d7fa-4d4d-8a74-bc8c8fc607e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.425184 Aug 05 20:06:55.787031 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 172/332] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:55 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:55.955106 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:55.964084 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:55.983762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:55.996950 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:55.997965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:55.999179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:56.000299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:56.001100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:56.368334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:56.385067 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9af1f141-3bd8-40fa-b0a0-d980670ef595 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.437861 Aug 05 20:06:56.393022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 173/333] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:55 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:56.715747 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-bcb79d95-79b8-4970-a320-6ffae5d83642 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Action: 'create', calling method: .version_select at 0x7f56929c38b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2140324307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+h7dAanpHRoZ26SL5DsS5lB5KdEbfY5Vq290fGamdyg4aJkAHgNegMs3tx6xj5jT1zqjSukb+h+cFgKaz2alCycxHfn+55ZQlmjTeAIk2xZyhiRPSEzNHE90aAYD4dwQ=="}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:56.780948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-bcb79d95-79b8-4970-a320-6ffae5d83642 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Getting quotas for project ec13d23d483b47f6b8f45c9aedea072a. Resources: {'key_pairs'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:06:56.793991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-bcb79d95-79b8-4970-a320-6ffae5d83642 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Getting quotas for user 69ccb4c3326c47a3ab69bbf5830ab1ef and project ec13d23d483b47f6b8f45c9aedea072a. Resources: {'key_pairs'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:06:56.903539 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-bcb79d95-79b8-4970-a320-6ffae5d83642 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.506779 Aug 05 20:06:56.904830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 174/334] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:06:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:56.969840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:56.974157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:57.003738 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:57.005532 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:57.006208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:57.007182 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:57.007904 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:57.008688 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:57.415516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:57.444841 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:57.448681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:57.450172 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ed9310c4-6435-4ee1-81d3-89fb7287c5dd tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.487519 Aug 05 20:06:57.464504 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 175/335] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:56 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:06:57.472231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:57.473674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:57.484172 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:57.485362 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:57.486274 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:57.487211 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:57.487964 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:57.489201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:57.726671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:57.744254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3abc284d-484a-428d-beae-00fce2bd2145 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.276951 Aug 05 20:06:57.755814 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 176/336] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:57 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:58.477636 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:58.479066 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:58.491101 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:58.491593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:58.492256 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:58.492982 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:58.493439 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:58.493900 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:59.125721 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:59.142729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:59.151635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:59.153984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-54ff3fe5-8bef-49c7-aded-4cc936da9e0d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.679311 Aug 05 20:06:59.154606 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 177/337] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:06:58 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:06:59.174495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:59.176473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:59.221236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:59.228860 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.network.neutron [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] validate_networks() for [('0e6eb1b0-c7d1-48fb-bae8-24a190109c29', None, None, None, None, None)] {{(pid=118175) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:06:59.234907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:59.235879 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:59.236938 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:59.237598 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:59.238774 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:59.521800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:59.542281 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9b3d33c5-0877-478b-94fa-b2b046972e71 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.383552 Aug 05 20:06:59.546663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 178/338] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:59 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:59.991439 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Flavor limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:06:59.992283 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Image limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:06:59.993073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Flavor pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:06:59.993687 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Image pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:06:59.994332 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:07:00.012798 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.013836 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.014376 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.015307 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.016171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.016792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.072034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for project 43323ff64b8843639e0428c69d5c71c1. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:00.085164 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for user 67e79817ed9e40728f92a22053a24118 and project 43323ff64b8843639e0428c69d5c71c1. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:00.118048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Going to run 1 instances... {{(pid=118175) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:07:00.125558 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118175) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:07:00.183190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:00.185846 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:00.197295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.199383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.200030 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.203005 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.204095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.205367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.241324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6499b18a-a2f8-4e5d-9e7f-13b8ac0a2376 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 20.578977 Aug 05 20:07:00.248423 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 161/339] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:06:39 2022] POST /compute/v2.1/servers => generated 400 bytes in 20589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:07:00.256001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-56669350-1c2e-4a9d-818b-fd70ee6a7d33 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:00.259894 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-56669350-1c2e-4a9d-818b-fd70ee6a7d33 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:00.411915 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-56669350-1c2e-4a9d-818b-fd70ee6a7d33 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:00.438369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-56669350-1c2e-4a9d-818b-fd70ee6a7d33 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1241 microversion: 2.1 time: 0.188254 Aug 05 20:07:00.452889 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 162/340] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:00 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1241 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:00.465646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:00.479991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:00.481614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:00.482680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fddcb51a-cfb9-4e51-871d-50f59d64b494 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1739 microversion: 2.20 time: 0.307997 Aug 05 20:07:00.488060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 179/341] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:00 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:00.589773 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:00.589773 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:00.602929 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.603444 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.603933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.604706 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.605207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.606990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.989206 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:01.011288 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-80d34c38-35c7-48c1-9f6d-21ec2f44c1e6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.425369 Aug 05 20:07:01.012370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 163/342] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:00 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:01.464246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:01.464985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:01.483169 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:01.483663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:01.484148 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:01.484862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:01.485319 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:01.485754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:01.513534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:01.515834 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:01.558303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:01.561090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:01.561714 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:01.562956 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:01.564346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:01.566560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:01.585460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:01.596777 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-758a16f8-14c3-4c3e-b55d-78f07fedc237 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1245 microversion: 2.1 time: 0.136333 Aug 05 20:07:01.602101 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 180/343] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:01 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1245 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:01.909863 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:01.918958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:01.920943 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:01.922788 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-77019efe-18cb-4327-a76d-5862ef348aea tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1721 microversion: 2.20 time: 0.416437 Aug 05 20:07:01.923738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 164/344] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:01 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1721 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:02.040837 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:02.044147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:02.056940 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.057568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.058313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.059499 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.060926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.061965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.291663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:02.302484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-999cf566-934d-4a2c-86c3-668e883fd4d6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.269019 Aug 05 20:07:02.303362 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 181/345] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:02 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:02.624646 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:02.625261 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:02.633453 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.633958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.634397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.635130 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.635580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.636023 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.714964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:02.724972 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fef5fbfe-9cc7-42cb-a9ae-c9591ec79dd2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1301 microversion: 2.1 time: 0.106236 Aug 05 20:07:02.725551 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 165/346] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:02 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:02.954568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:02.955430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:02.971443 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.971993 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.973203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.974034 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.974666 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.975956 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:03.266396 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:03.274796 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:03.276363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:03.277516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5782e17d-7b6d-4a04-a09e-62e44fe6377e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1721 microversion: 2.20 time: 0.328871 Aug 05 20:07:03.278067 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 182/347] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:02 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:03.323243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:03.323892 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:03.329987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:03.330475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:03.330901 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:03.331727 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:03.332259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:03.332741 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:03.491126 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:03.499983 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a7b5c48b-c468-4dd0-8cf9-edb9683ea1c6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1522 microversion: 2.1 time: 0.179462 Aug 05 20:07:03.499983 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 166/348] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:03 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:03.746052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:03.746668 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:03.752831 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:03.753209 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:03.754188 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:03.754886 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:03.755340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:03.755763 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:03.840919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:03.853103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1be3887c-2f96-42f6-b9d5-267da769f02b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1299 microversion: 2.1 time: 0.110643 Aug 05 20:07:03.853830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 183/349] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:03 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:04.042564 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-3a2f251b-c38e-4be0-bf36-bd4ec3fc3aa0 req-48b7869b-bc7e-46bb-84d9-afa9f349bc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49e6225-f22b-44fc-ad77-be5500dd95ca", "name": "network-vif-unplugged", "status": "completed", "tag": "1bdc744a-8e2b-4857-9c57-b9ac61ab593c"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:04.063718 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-3a2f251b-c38e-4be0-bf36-bd4ec3fc3aa0 req-48b7869b-bc7e-46bb-84d9-afa9f349bc25 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.064435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-3a2f251b-c38e-4be0-bf36-bd4ec3fc3aa0 req-48b7869b-bc7e-46bb-84d9-afa9f349bc25 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.065065 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-3a2f251b-c38e-4be0-bf36-bd4ec3fc3aa0 req-48b7869b-bc7e-46bb-84d9-afa9f349bc25 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.082243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-3a2f251b-c38e-4be0-bf36-bd4ec3fc3aa0 req-48b7869b-bc7e-46bb-84d9-afa9f349bc25 service nova] Creating event network-vif-unplugged:1bdc744a-8e2b-4857-9c57-b9ac61ab593c for instance a49e6225-f22b-44fc-ad77-be5500dd95ca on hv-cinder-85221 Aug 05 20:07:04.093183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-3a2f251b-c38e-4be0-bf36-bd4ec3fc3aa0 req-48b7869b-bc7e-46bb-84d9-afa9f349bc25 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055302 Aug 05 20:07:04.094359 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 167/350] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:04.308671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:04.309804 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:04.317794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.319827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.320483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.321612 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.322239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.322917 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.524107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:04.525153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:04.533199 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.534059 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.535330 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.536902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.538158 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.539032 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.642764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:04.656689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:04.658353 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:04.659684 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b44a66a5-8144-4815-97fb-4864c078f234 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1721 microversion: 2.20 time: 0.355336 Aug 05 20:07:04.662182 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 184/351] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:04 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:04.809140 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:04.822263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-637cf1ec-8f7d-4c4d-9aa6-340d97f75d3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1502 microversion: 2.1 time: 0.303512 Aug 05 20:07:04.825078 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 168/352] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:04 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1502 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:04.863718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:04.864541 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:04.873882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.874374 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.876541 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.877685 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.877773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.878142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.878248 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:04.879827 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:04.890396 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.891091 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.891628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.892883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.893506 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.893942 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:05.085784 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:05.100071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5d4624b2-2aab-4080-9a46-4bad2f7bb8b0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1517 microversion: 2.1 time: 0.251132 Aug 05 20:07:05.100802 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 185/353] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:04 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1517 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:05.104438 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:05.112422 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8eae9191-6cc8-44c9-85d6-99f858fb60a0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.239016 Aug 05 20:07:05.113234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 169/354] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:04 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:05.688128 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:05.688742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:05.697822 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:05.698390 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:05.699060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:05.700827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:05.701461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:05.701895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:05.852712 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:05.868084 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:05.869683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:05.870927 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-66ea82f0-90be-4c56-9285-f20ddcb5cc13 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1721 microversion: 2.20 time: 0.187651 Aug 05 20:07:05.871654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 186/355] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:05 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:06.141719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:06.142392 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:06.152042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.152776 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.153576 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.154546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.155151 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.155727 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.379582 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:06.389645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-22af7a0a-3cd8-4fb9-ac09-2d0dab8896eb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.258006 Aug 05 20:07:06.390232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 170/356] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:06 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:06.591993 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:06.593889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:06.610337 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.611042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.611648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.612391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.612891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.613321 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.655522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lazy-loading 'flavor' on Instance uuid 2cfe824c-c06c-4210-8616-5c6f7331d1a2 {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:07:06.781681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:06.813423 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=4 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:06.814436 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-6bf1cc1f-ce5f-47d7-82a4-9fc0f9cbb9a7 req-ad70b0c1-f589-408e-b667-8eecab68f961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7081e39-a5af-4ee0-89d2-90d44d2b7dd1", "tag": "5f35a769-e454-4292-84b5-95f09e160754"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:06.837037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-6bf1cc1f-ce5f-47d7-82a4-9fc0f9cbb9a7 req-ad70b0c1-f589-408e-b667-8eecab68f961 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.837684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-6bf1cc1f-ce5f-47d7-82a4-9fc0f9cbb9a7 req-ad70b0c1-f589-408e-b667-8eecab68f961 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.838133 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-6bf1cc1f-ce5f-47d7-82a4-9fc0f9cbb9a7 req-ad70b0c1-f589-408e-b667-8eecab68f961 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.861021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-6bf1cc1f-ce5f-47d7-82a4-9fc0f9cbb9a7 req-ad70b0c1-f589-408e-b667-8eecab68f961 service nova] Creating event network-changed:5f35a769-e454-4292-84b5-95f09e160754 for instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 on hv-cinder-85221 Aug 05 20:07:06.867626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2ce47189-19a1-4053-987b-f182ac7f4ff3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2/action" status: 200 len: 32 microversion: 2.1 time: 0.282274 Aug 05 20:07:06.869030 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 187/357] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:07:06 2022] POST /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2/action => generated 32 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:07:06.870146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-6bf1cc1f-ce5f-47d7-82a4-9fc0f9cbb9a7 req-ad70b0c1-f589-408e-b667-8eecab68f961 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058191 Aug 05 20:07:06.870972 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 171/358] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:06.880474 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:06.881010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:06.888577 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.889468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.890139 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.891050 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.891718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.892380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.900107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:06.901360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:06.913795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.914540 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.915171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.916085 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.916748 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.917370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:07.162363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:07.176337 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:07.178852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:07.180592 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7dc970aa-66d4-4c87-aa37-7f460b9ee7d0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1664 microversion: 2.20 time: 0.289890 Aug 05 20:07:07.182206 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 172/359] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:06 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1664 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:07.204115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-923a9e11-8fdd-4b15-8215-90e3abfc2a5f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f344e2d-d033-4e20-84f5-417f78869236"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:07.207830 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-923a9e11-8fdd-4b15-8215-90e3abfc2a5f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:07.214194 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-923a9e11-8fdd-4b15-8215-90e3abfc2a5f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:07.214970 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-923a9e11-8fdd-4b15-8215-90e3abfc2a5f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:07.215658 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-923a9e11-8fdd-4b15-8215-90e3abfc2a5f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:07.216391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-923a9e11-8fdd-4b15-8215-90e3abfc2a5f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:07.217006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-923a9e11-8fdd-4b15-8215-90e3abfc2a5f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:07.217591 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-923a9e11-8fdd-4b15-8215-90e3abfc2a5f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:07.299069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:07.307104 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-78faaebd-1899-4322-b37b-070bdad31eb8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.431985 Aug 05 20:07:07.307679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 188/360] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:06 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:07.412639 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:07.413643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:07.420345 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:07.421131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:07.421797 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:07.423076 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:07.423757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:07.424515 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:07.659448 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-923a9e11-8fdd-4b15-8215-90e3abfc2a5f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.459224 Aug 05 20:07:07.661113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 173/361] 10.222.0.95 () {62 vars in 1364 bytes} [Fri Aug 5 20:07:07 2022] POST /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments => generated 188 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 20:07:07.829958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:07.830566 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:07.841168 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:07.842555 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:07.843196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:07.844530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:07.845060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:07.846059 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:07.907362 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118175) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:07:07.949522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:07.963614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9595ab88-caeb-466b-b193-d03d992be966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.555352 Aug 05 20:07:07.985709 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 189/362] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:07 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:08.037238 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-dba45c18-6f75-4680-b1a9-9b803cabcb16 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/action" status: 202 len: 0 microversion: 2.20 time: 0.214423 Aug 05 20:07:08.038871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 174/363] 10.222.0.95 () {62 vars in 1319 bytes} [Fri Aug 5 20:07:07 2022] POST /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:07:08.052757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:08.055088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:08.075230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.075803 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.084983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.085755 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.088032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.089704 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.330837 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:08.332769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:08.344468 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.358460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.359080 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.359856 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.360416 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.360752 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.426966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:08.438197 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:08.439724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:08.441904 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fc1495d1-4546-4d78-96e0-73ca5282a141 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1750 microversion: 2.20 time: 0.396239 Aug 05 20:07:08.442677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 190/364] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:08 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1750 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:08.561441 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:08.570540 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5c57c7b8-081d-4ba2-a45c-b0f0d51b6025 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.243835 Aug 05 20:07:08.571118 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 175/365] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:08 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:08.990267 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:08.992631 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:09.027341 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.027875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.028333 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.029610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.030109 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.030689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.465794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:09.466437 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:09.474124 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.474611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.475054 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.475868 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.476506 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.477091 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.640022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:09.655385 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ddd2bde7-4e58-48ca-9542-4c67d3b000c7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.672124 Aug 05 20:07:09.660033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 191/366] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:08 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:09.674902 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:09.678501 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:09.695454 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.696796 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.702288 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.704947 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.705618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.706212 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:10.042389 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:10.065957 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:10.076668 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-36a57b82-2bee-4046-86ff-8c18d05a6a64 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.414310 Aug 05 20:07:10.083185 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 192/367] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:09 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:10.351665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:10.355470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:10.361089 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:10.363073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:10.365317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a396a05d-b761-42a3-aa42-acf271493572 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1750 microversion: 2.20 time: 0.903769 Aug 05 20:07:10.366049 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 176/368] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:09 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1750 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:07:10.683835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:10.684461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:10.694729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:10.695674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:10.696570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:10.699818 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:10.700930 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:10.701666 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:10.953684 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:10.963613 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-43d6d22d-dc5a-4522-9536-b145a6d4f304 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.283511 Aug 05 20:07:10.964233 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 193/369] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:10 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:11.120149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:11.122778 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:11.138287 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=8 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:11.148400 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.149394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.150430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.151886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.153010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.153939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.391036 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:11.404841 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:11.414487 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.414989 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.419482 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.431822 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.432374 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.432834 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.482445 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:11.505394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-2bad0e5f-09be-4ad9-a756-102768a168d4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.396231 Aug 05 20:07:11.510480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 177/370] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:11 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:11.746646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:11.773147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:11.775540 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:11.782405 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1fcd3ad5-36bf-4f26-aaaa-15e779168098 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1752 microversion: 2.20 time: 0.394063 Aug 05 20:07:11.799809 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 194/371] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:11 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1752 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:11.985753 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:11.986447 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:12.000259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.000259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.000988 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.001907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.003328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.008079 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.327105 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:12.339546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6f7c2eac-ba7d-4d44-89a4-07a768e31140 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.358341 Aug 05 20:07:12.341841 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 178/372] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:11 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:12.530597 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:12.531991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:12.542126 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.542947 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.543922 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.544894 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.545575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.546276 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.821684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:12.822398 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:12.837803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.838662 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.839335 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.840295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.840922 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.841619 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.977485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:12.992122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-434c691c-e447-4e03-be0a-67209ceaf520 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.465285 Aug 05 20:07:12.993043 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 195/373] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:12 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:13.091747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:13.110765 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:13.112599 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:13.114737 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-00a376b4-cc2c-4bd7-8083-a7f8d66d5665 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.298866 Aug 05 20:07:13.124861 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 179/374] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:12 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:13.364068 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1852825730", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "networks": [{"uuid": "a6618a56-807a-484d-bf9c-8b5af4857258"}]}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:13.371609 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:13.372772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:13.386832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:13.389104 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:13.392213 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:13.400639 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:13.401132 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:13.401579 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:13.487192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] validate_networks() for [('a6618a56-807a-484d-bf9c-8b5af4857258', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:07:13.685447 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:13.705079 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bca3c023-5ae2-4e04-a863-226811672a74 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.343474 Aug 05 20:07:13.719006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 180/375] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:13 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:14.014385 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:14.015005 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:14.018545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:07:14.019018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:07:14.019467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:07:14.019904 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:07:14.020328 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:07:14.038650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.044029 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.044678 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.044924 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.045711 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.046157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.046922 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.047389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.047848 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.056148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.056993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.057629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.114333 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Getting quotas for project 62c8d8166fe14ab5a1651d0d48dff37a. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:14.125870 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Getting quotas for user 3b2fcb1887f749dcb488c63054290a45 and project 62c8d8166fe14ab5a1651d0d48dff37a. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:14.140185 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:07:14.142590 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:07:14.191996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-936cda7a-9815-4a02-ab51-fda7f4096368 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835675 Aug 05 20:07:14.192950 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 196/376] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:07:14.204944 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:14.205563 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:14.213628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.214125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.214557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.215452 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.216104 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.216692 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.393127 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:14.407036 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-704ba598-021a-48b6-acdf-7c2184d71fb4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.396305 Aug 05 20:07:14.407652 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 181/377] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:14 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:14.440629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-436a8a78-9dcc-4311-996a-4bc6244e4807 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:14.443317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-436a8a78-9dcc-4311-996a-4bc6244e4807 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:14.460781 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:14.478720 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:14.487304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:14.491184 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a7719e5b-ee02-47a4-9f3a-55221fbf3b9b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.290695 Aug 05 20:07:14.492315 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 197/378] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:14 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:14.686845 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-436a8a78-9dcc-4311-996a-4bc6244e4807 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:14.697152 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-436a8a78-9dcc-4311-996a-4bc6244e4807 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1219 microversion: 2.1 time: 0.267924 Aug 05 20:07:14.699635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 182/379] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:14 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1219 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:14.730508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:14.731671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:14.744569 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.745322 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.745856 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.746648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.749276 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.749796 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.897423 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-5757f3ba-331d-401a-abd5-757513c45f57 req-a646aa39-85fc-4708-88bb-6d29952142da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7081e39-a5af-4ee0-89d2-90d44d2b7dd1", "name": "network-vif-plugged", "status": "completed", "tag": "5f35a769-e454-4292-84b5-95f09e160754"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:14.926528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-5757f3ba-331d-401a-abd5-757513c45f57 req-a646aa39-85fc-4708-88bb-6d29952142da service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.929816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-5757f3ba-331d-401a-abd5-757513c45f57 req-a646aa39-85fc-4708-88bb-6d29952142da service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.930738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-5757f3ba-331d-401a-abd5-757513c45f57 req-a646aa39-85fc-4708-88bb-6d29952142da service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.968200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-5757f3ba-331d-401a-abd5-757513c45f57 req-a646aa39-85fc-4708-88bb-6d29952142da service nova] Creating event network-vif-plugged:5f35a769-e454-4292-84b5-95f09e160754 for instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 on hv-cinder-85221 Aug 05 20:07:14.980680 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-5757f3ba-331d-401a-abd5-757513c45f57 req-a646aa39-85fc-4708-88bb-6d29952142da service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090763 Aug 05 20:07:14.991645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 183/380] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:15.088919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:15.103813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-923c2475-079f-4f0e-9e80-0e77dc6b2652 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.376574 Aug 05 20:07:15.104737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 198/381] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:14 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:15.431721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:15.432986 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:15.451971 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.454920 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.455607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.457149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.465504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.466262 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.523196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:15.524840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:15.541501 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.544146 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.546969 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.548078 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.550481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.552483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.848783 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:15.865595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-01d48740-76af-47d6-8019-9900f614f96e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.439284 Aug 05 20:07:15.867689 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 184/382] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:15 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:15.885483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:15.888946 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:15.928574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.930733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.930958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:15.931862 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.932631 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.936922 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.937567 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.948592 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:15.951360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:15.960078 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ea6b2441-6c98-4c04-bc61-268fcb0f46a5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.442063 Aug 05 20:07:15.961318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 199/383] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:15 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:16.053896 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:16.066405 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b4a87727-70ec-4987-826b-ebd09abafd58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1223 microversion: 2.1 time: 0.195284 Aug 05 20:07:16.079973 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 185/384] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:15 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1223 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:16.137286 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:16.137948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:16.141651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:16.162203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:16.162790 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:16.165502 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:16.167636 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:16.169321 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:16.170528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:16.530280 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:16.546762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c8904de6-b97b-434b-985c-439e6d8578f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.419329 Aug 05 20:07:16.558752 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 200/385] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:16 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:16.898035 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:16.899348 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:16.926172 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:16.931446 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:16.933220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:16.934484 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:16.940135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:16.944666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:16.999696 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:17.000718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:17.016863 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.019853 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.021115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.023011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.025340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.026019 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.347169 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:17.367420 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:17.372300 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:17.376268 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-012384c9-b1e1-4a55-bf12-e7a06c5e3149 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.391880 Aug 05 20:07:17.379966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 201/386] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:16 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:17.385046 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:17.387736 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:17.399093 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.399862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.400476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.401343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.401945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.402520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.522377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:17.527403 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:17.530783 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b5ac54a7-28b9-42dc-87bd-1f1d1e428e10 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1271 microversion: 2.1 time: 0.149461 Aug 05 20:07:17.531824 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 202/387] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:17 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:17.537644 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-760ed7f4-6298-48b8-918a-671879dcdb31 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.648990 Aug 05 20:07:17.538500 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 186/388] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:16 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:17.572192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:17.573132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:17.579241 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.580037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.580575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.581911 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.582533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.583047 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.773052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:17.797786 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5eb091d6-e873-4c0b-8c4e-5142c98bd1b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.229284 Aug 05 20:07:17.803218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 203/389] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:17 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:18.413973 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:18.414798 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:18.446393 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.447212 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.447870 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.448947 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.449583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.450176 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.558069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:18.559223 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:18.578786 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.579724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.580516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.581502 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.582178 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.582822 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.586190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:18.818692 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:18.832124 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:18.843541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:18.847032 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4e0950a5-3d3b-4c47-8da7-f9899d4fb71d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.437899 Aug 05 20:07:18.850329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 187/390] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:18 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:18.861771 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:18.868221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:18.877456 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:18.882731 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ae3f884c-17ac-4103-90fb-2f6cdcca77c3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1271 microversion: 2.1 time: 0.328330 Aug 05 20:07:18.884269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 204/391] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:18 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1271 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:18.902002 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.902887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.903538 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.904508 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.905171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.905814 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.909773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:18.914409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:18.934094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.939730 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.940522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.942972 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.946017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.952063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.196753 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:19.207335 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-26e5ba63-b282-4b2e-8fe3-46d32928a492 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.351727 Aug 05 20:07:19.208654 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 188/392] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:18 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:19.362060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:19.377720 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-afcb0697-435b-42c7-b9a7-42c33b1834c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1365 microversion: 2.1 time: 0.486902 Aug 05 20:07:19.378946 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 205/393] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:18 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1365 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:19.879521 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:19.880654 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:19.892027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:19.912086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:19.912909 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:19.915171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.915769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.916249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.917002 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.923297 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.923765 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.928959 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.929455 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.930089 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.931044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.931691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.932730 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:20.314248 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:20.330180 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:20.333203 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:20.334919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b5bf710e-90a9-47ac-ba1e-b5db0467ce0e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.460183 Aug 05 20:07:20.345299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:20.354659 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-755034fc-1a12-4638-8995-035fa78529a5 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1271 microversion: 2.1 time: 0.448491 Aug 05 20:07:20.358178 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 189/394] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:19 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:20.359901 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 206/395] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:19 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1271 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:20.371240 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-775367283", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2140324307", "security_groups": [{"name": "tempest-secgroup-smoke-2086564048"}], "networks": [{"uuid": "cd5a6700-bc64-4e2e-a8ff-26a2067cd98d"}], "block_device_mapping_v2": [{"uuid": "9a0d54a7-8876-4ae2-b821-3ebd2ea7fe12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:20.375259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:20.376423 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:20.390482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.394435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.396583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:20.399170 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.401534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.402247 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:20.773404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:20.781387 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a28f9eb8-a2aa-4a25-a92c-b9b640122485 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.414539 Aug 05 20:07:20.781986 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 190/396] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:20 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:20.796102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] validate_networks() for [('cd5a6700-bc64-4e2e-a8ff-26a2067cd98d', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:07:20.807017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:20.808230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:20.825801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.826858 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.827317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:20.829502 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.829977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.830413 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:21.145914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:21.172800 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-dd773086-af12-4837-89cf-fc5790e2caf2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1556 microversion: 2.1 time: 0.374508 Aug 05 20:07:21.173669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 191/397] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:20 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1556 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:21.197216 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5b7752e4-63cc-40cd-a78d-595e7e12c229 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:21.198269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5b7752e4-63cc-40cd-a78d-595e7e12c229 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:21.205936 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b7752e4-63cc-40cd-a78d-595e7e12c229 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:21.207633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b7752e4-63cc-40cd-a78d-595e7e12c229 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:21.208693 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b7752e4-63cc-40cd-a78d-595e7e12c229 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:21.215364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b7752e4-63cc-40cd-a78d-595e7e12c229 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:21.216311 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b7752e4-63cc-40cd-a78d-595e7e12c229 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:21.216999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5b7752e4-63cc-40cd-a78d-595e7e12c229 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:21.379243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5b7752e4-63cc-40cd-a78d-595e7e12c229 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188091 Aug 05 20:07:21.388907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 192/398] 10.222.0.95 () {58 vars in 1275 bytes} [Fri Aug 5 20:07:21 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:21.397089 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:21.398716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:21.405840 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:21.406716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:21.407369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:21.410205 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:21.411068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:21.411717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.368311 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:22.377549 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:22.382038 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:22.388221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b3b4acf9-1a61-4daf-98f0-6870a88e4458 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.996430 Aug 05 20:07:22.389067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 193/399] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:21 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:22.396616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:22.397470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:22.408321 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.410824 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.411354 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.412324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.414435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.415055 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.460893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:07:22.461349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:07:22.462113 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:07:22.462707 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:07:22.463154 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:07:22.478967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.479461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.479929 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.480665 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.481119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.484861 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.545592 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Getting quotas for project ec13d23d483b47f6b8f45c9aedea072a. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:22.554752 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Getting quotas for user 69ccb4c3326c47a3ab69bbf5830ab1ef and project ec13d23d483b47f6b8f45c9aedea072a. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:22.709359 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:07:22.711378 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a0d54a7-8876-4ae2-b821-3ebd2ea7fe12',volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:07:22.789697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:22.805563 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9b2ca03d-ac00-49ec-ba9b-b894e5872a35 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1271 microversion: 2.1 time: 0.415240 Aug 05 20:07:22.819805 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 194/400] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:22 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1271 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:22.825103 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:22.844650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:22.858986 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.876605 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.878783 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.880015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.884609 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.886574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.980529 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:22.981568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-20324011-bcc9-48eb-9353-2e171fd7df97 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.620538 Aug 05 20:07:22.982408 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 207/401] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:07:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:07:22.994602 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c4fd805c-6d24-4339-b7ed-0fb54f9101f7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:22.995507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c4fd805c-6d24-4339-b7ed-0fb54f9101f7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:23.353608 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c4fd805c-6d24-4339-b7ed-0fb54f9101f7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:23.360895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c4fd805c-6d24-4339-b7ed-0fb54f9101f7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1088 microversion: 2.1 time: 0.370134 Aug 05 20:07:23.363805 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 208/402] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:22 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1088 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:23.440174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:23.444349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:23.466433 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:23.485619 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:23.487131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:23.500872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:23.501729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:23.502495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:23.707192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:23.722508 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3139a687-0864-48da-91aa-437c13149577 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.900841 Aug 05 20:07:23.736453 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 195/403] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:22 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:23.826701 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:23.827510 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:23.840152 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:23.842888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:23.843485 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:23.844365 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:23.852643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:23.853271 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.093581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:24.105613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a7932576-b225-4a2a-9e5a-5cc664701111 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1271 microversion: 2.1 time: 0.282749 Aug 05 20:07:24.106542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 196/404] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:23 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:24.175250 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:24.189311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:24.192664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:24.195090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e0ba6286-a0b1-4cb8-abed-bf640ee9332f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.785743 Aug 05 20:07:24.197161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 209/405] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:23 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:24.320418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-ee941101-3727-4364-8cc9-4be288f8775e req-47e10188-4144-4265-9420-b72a9f68ebdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7081e39-a5af-4ee0-89d2-90d44d2b7dd1", "tag": "5f35a769-e454-4292-84b5-95f09e160754"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:24.331967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-ee941101-3727-4364-8cc9-4be288f8775e req-47e10188-4144-4265-9420-b72a9f68ebdb service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.332880 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-ee941101-3727-4364-8cc9-4be288f8775e req-47e10188-4144-4265-9420-b72a9f68ebdb service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.334283 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-ee941101-3727-4364-8cc9-4be288f8775e req-47e10188-4144-4265-9420-b72a9f68ebdb service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.348707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-ee941101-3727-4364-8cc9-4be288f8775e req-47e10188-4144-4265-9420-b72a9f68ebdb service nova] Creating event network-changed:5f35a769-e454-4292-84b5-95f09e160754 for instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 on hv-cinder-85221 Aug 05 20:07:24.355226 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-ee941101-3727-4364-8cc9-4be288f8775e req-47e10188-4144-4265-9420-b72a9f68ebdb service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038775 Aug 05 20:07:24.356351 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 197/406] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:24.385144 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:24.386390 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:24.394688 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.404782 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.405576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.406505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.407278 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.408043 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.544034 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:24.557722 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-60c5fcde-3c26-47bd-a15e-c9dbf8045e1d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1138 microversion: 2.1 time: 0.176206 Aug 05 20:07:24.560728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 210/407] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:24 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1138 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:24.745996 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:24.750598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:24.751319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:24.775882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.776651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.777280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.778162 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.794928 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.795644 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.115269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:25.125810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-af6fcfbb-3281-4bf5-b9d4-5d1addac7021 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.380648 Aug 05 20:07:25.126703 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:25.127409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:25.127560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 198/408] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:24 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:25.149799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.152384 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.153082 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.154800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.162637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.163563 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.221296 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:25.223305 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:25.248892 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.249460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.258387 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.262367 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.267147 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.267732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.694033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:25.718914 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:25.719527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:25.721055 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:25.723242 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f7530b50-2d63-4ba0-8d61-a8836134163d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.506257 Aug 05 20:07:25.752200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 199/409] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:25 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:25.762316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:25.767528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:25.768696 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9849d458-b931-4bbe-95a4-853272b987ea tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1271 microversion: 2.1 time: 0.643242 Aug 05 20:07:25.772823 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 211/410] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:25 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1271 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:25.813583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.818990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.820306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.822892 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.824586 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.826255 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.960252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:25.987060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f2057d92-8afa-43bb-a7d1-5d6ad18fb103 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1138 microversion: 2.1 time: 0.222519 Aug 05 20:07:25.994845 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 200/411] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:25 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1138 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:26.154855 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:26.156058 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:26.208155 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.209036 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.209749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.210919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.215967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.217211 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.717129 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:26.727817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fcc3da44-3bf4-4951-85d8-aa652979b779 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.580249 Aug 05 20:07:26.743472 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 212/412] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:26 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:26.751544 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:26.752404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:26.760108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.761399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.762063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.763051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.763900 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.765046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.798592 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:26.800026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:26.821291 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.821799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.822238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.822959 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.825366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.825877 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.913992 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:26.923494 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-da751f90-32fd-4104-b8af-06f708fa35ee tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1271 microversion: 2.1 time: 0.130323 Aug 05 20:07:26.924643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 213/413] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:26 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:26.959993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:26.972007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:26.974692 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:26.977697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-723175cb-a11e-46e8-8f6c-f1d3bf92ad29 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.231015 Aug 05 20:07:26.979540 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 201/414] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:26 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:27.019853 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:27.021909 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:27.029824 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.030799 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.031461 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.032755 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.033421 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.034051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.104515 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:27.112217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ecbe14cb-caac-4132-bcb5-9e88ad30feba tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1186 microversion: 2.1 time: 0.098613 Aug 05 20:07:27.113207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 202/415] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:27 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:27.157616 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f68c1528-0220-4905-b991-0b32fd9a9dc4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Action: 'create', calling method: .version_select at 0x7f5691ea0670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1260976200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMueeGuTnBOCKEnpZqVt5cZhj7yLAY7Qfc/ppCWrRu8DmvaRLl8HacPyblalPKfV4AyKkDjTftIJ0XUwe42Vhe78eeMgglh812umrm8xLo7tl/L/cgv9Sen+CV3NfU6nQ=="}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:27.173664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-f68c1528-0220-4905-b991-0b32fd9a9dc4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Getting quotas for project b0ab093edb944772ae7b6fd285178a43. Resources: {'key_pairs'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:27.177879 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-f68c1528-0220-4905-b991-0b32fd9a9dc4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Getting quotas for user 6f89a5e4981e423b84d5f28b33bd9629 and project b0ab093edb944772ae7b6fd285178a43. Resources: {'key_pairs'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:27.200764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f68c1528-0220-4905-b991-0b32fd9a9dc4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.274016 Aug 05 20:07:27.201484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 214/416] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:07:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:27.752734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:27.752734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:27.759917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.760705 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.761214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.762011 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.762519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.763168 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.947527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:27.947948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:27.956193 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.956193 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.956193 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.956527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.957898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.958491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.154962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:28.176827 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-77b13c9d-2c3e-4050-9489-2ecf798d23a5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.426678 Aug 05 20:07:28.177719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 203/417] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:27 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:28.187144 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:28.188157 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:28.197419 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.197911 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.198201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:28.198335 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.199888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.201256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.202955 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.211306 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4d82f982-948f-4802-85b6-05f857ddc680 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1289 microversion: 2.1 time: 0.268514 Aug 05 20:07:28.213074 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 215/418] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:27 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1289 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:28.230978 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:28.231660 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:28.241116 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.242485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.243214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.243992 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.244610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.245713 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.439251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:28.459896 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7c70ff18-3cd8-45bc-93de-9371ca7f8436 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1204 microversion: 2.1 time: 0.234312 Aug 05 20:07:28.460744 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 216/419] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:28 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1204 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:28.588056 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:28.597395 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:28.605234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:28.606739 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-410ebd01-b172-4cfe-b1e9-9a90fddad63d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.428340 Aug 05 20:07:28.609610 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 204/420] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:28 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:29.199240 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:29.199957 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:29.214548 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.215937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.217553 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.218413 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.219984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.222739 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.233738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:29.234557 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:29.247405 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.259478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.261402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.262622 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.264778 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.265482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.583701 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:29.593139 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4d7c7f8d-a348-4e32-b34f-b8d5c7cbd02e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.363361 Aug 05 20:07:29.597298 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:29.597467 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 205/421] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:29 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:29.608115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-44ef273b-2238-4aa6-9259-7997993aded6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.414174 Aug 05 20:07:29.610402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:29.611302 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:29.621360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 217/422] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:29 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:29.623496 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.624030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.624519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.625237 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.626828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.628957 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.645985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:29.646596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:29.652673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.653394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.653980 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.654860 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.655315 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.655939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.817849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:29.821327 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:29.827535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:29.829050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0b86f773-a593-4f65-bd22-cee14b17006e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1272 microversion: 2.1 time: 0.230756 Aug 05 20:07:29.829215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:29.830272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8ab493b6-d12d-455a-8e7a-543f80f19ffe tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.189049 Aug 05 20:07:29.830413 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 206/423] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:29 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:29.831809 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 218/424] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:29 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:30.621893 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:30.623232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:30.632675 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:30.634024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:30.642138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:30.642970 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:30.643442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:30.644412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.645607 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:30.646377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:30.647055 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.647220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:30.647683 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.648677 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:30.649144 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:30.649767 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.910688 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:30.919483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2e4c5ef2-afc4-4b27-938f-734f0e800c19 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.290708 Aug 05 20:07:30.929046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:30.932422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 219/425] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:30 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:30.938947 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:30.939846 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:30.948707 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:30.949401 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:30.950060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.950979 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:30.951653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:30.952304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.952416 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3195d29b-b70c-40c6-8088-17d8cff86333 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.334385 Aug 05 20:07:30.955128 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 207/426] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:30 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:30.964218 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:30.965588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:31.001435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.002550 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.003587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.004541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.008031 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.008557 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.158626 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:31.167793 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:31.169638 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:31.170842 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d86be03b-0573-41b8-be1b-25907cf3005c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.214552 Aug 05 20:07:31.171408 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 208/427] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:30 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:31.176517 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-9ec76d38-030b-4575-bd10-614b7c32735d req-e8f565f1-b97f-4e13-8b0f-da9004d6ee5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e532dd-0c95-4d65-9f31-a698bdfdf52f", "tag": "1a52d740-fd7b-4b85-b351-dfbb3497a9af"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:31.186869 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-9ec76d38-030b-4575-bd10-614b7c32735d req-e8f565f1-b97f-4e13-8b0f-da9004d6ee5b service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.187365 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-9ec76d38-030b-4575-bd10-614b7c32735d req-e8f565f1-b97f-4e13-8b0f-da9004d6ee5b service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.187826 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-9ec76d38-030b-4575-bd10-614b7c32735d req-e8f565f1-b97f-4e13-8b0f-da9004d6ee5b service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.193967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:31.200552 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-9ec76d38-030b-4575-bd10-614b7c32735d req-e8f565f1-b97f-4e13-8b0f-da9004d6ee5b service nova] Creating event network-changed:1a52d740-fd7b-4b85-b351-dfbb3497a9af for instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f on hv-cinder-85221 Aug 05 20:07:31.202258 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-bac80583-ac17-4cbd-a8da-4735ecf6a53c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.268652 Aug 05 20:07:31.202792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 220/428] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:30 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:31.207447 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-9ec76d38-030b-4575-bd10-614b7c32735d req-e8f565f1-b97f-4e13-8b0f-da9004d6ee5b service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034684 Aug 05 20:07:31.208362 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 209/429] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:31.306569 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-39808ab7-43b0-4143-a276-a11fe438ea28 req-e801e28a-ce60-465a-90d2-2801bbe6e42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0de831f-1cb5-4286-9c10-0fb614962af7", "tag": "5a74e867-0a99-4c52-83b6-7c2e357cf53f"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:31.317930 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-39808ab7-43b0-4143-a276-a11fe438ea28 req-e801e28a-ce60-465a-90d2-2801bbe6e42e service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.318678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-39808ab7-43b0-4143-a276-a11fe438ea28 req-e801e28a-ce60-465a-90d2-2801bbe6e42e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.319114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-39808ab7-43b0-4143-a276-a11fe438ea28 req-e801e28a-ce60-465a-90d2-2801bbe6e42e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.330580 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-39808ab7-43b0-4143-a276-a11fe438ea28 req-e801e28a-ce60-465a-90d2-2801bbe6e42e service nova] Creating event network-changed:5a74e867-0a99-4c52-83b6-7c2e357cf53f for instance b0de831f-1cb5-4286-9c10-0fb614962af7 on hv-cinder-85221 Aug 05 20:07:31.337962 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-39808ab7-43b0-4143-a276-a11fe438ea28 req-e801e28a-ce60-465a-90d2-2801bbe6e42e service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035846 Aug 05 20:07:31.339109 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 221/430] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:31.947539 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:31.948279 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:31.954447 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.954932 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.955369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.956287 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.956887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.957462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.976318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:31.977127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:31.983184 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.983748 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.984289 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.985079 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.985611 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.986110 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:32.111200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:32.119771 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f6aa78a5-1c0b-4457-b8a6-65f1c54c401d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.177903 Aug 05 20:07:32.120488 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 210/431] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:31 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:32.146818 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:32.154872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0424d7f6-f31b-403a-8742-c9c983578200 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.184047 Aug 05 20:07:32.160441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 222/432] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:31 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:32.195646 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:32.196205 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:32.202990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:32.203804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:32.204578 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:32.205414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:32.206595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:32.207084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:32.224678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:32.225486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:32.231372 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:32.231944 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:32.232575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:32.233475 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:32.233938 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:32.234388 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:32.357886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:32.368665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:32.370654 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:32.372195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c5f90437-df3c-4a7a-9fd9-bae4875d5925 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.181032 Aug 05 20:07:32.373845 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 211/433] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:32 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:32.389914 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:32.398895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fe2fb0b3-b8c9-488c-8b16-9fef8be29217 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.178755 Aug 05 20:07:32.399478 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 223/434] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:32 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:33.141297 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:33.141919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:33.149493 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.150102 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.151546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.152291 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.152760 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.153193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.177016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:33.178655 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:33.179738 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=4 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:33.186834 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.187352 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.187800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.188514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.188973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.189401 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.193266 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:33.295135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:33.304106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a978772c-0b8c-4f43-a0ed-0464bd94c398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1503 microversion: 2.1 time: 0.166728 Aug 05 20:07:33.315828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 212/435] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:33 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:33.325538 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ec58de0-ab88-4a42-a938-7823f21faedc"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:33.325944 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:33.328015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:33.333583 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e4092a74-4187-497b-8aff-2cc1db2c2ad0 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.160878 Aug 05 20:07:33.334151 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 224/436] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:33 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:33.334418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.334989 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.335527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.336761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.337220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.337650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.355037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:33.362462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] HTTP exception thrown: Cannot 'attach_volume' instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 while it is in vm_state rescued Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Request method failure captured: Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: POST /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2/os-volume_attachments HTTP/1.1 Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 74 Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XgRdLYKXftSa7cksEAGEmp9Unty8uOHU92P1vhQu2l3nZ6lO4VbDxcp7avQ4TWjJyMjr4KUEYOhJEFSxdqwjwJlC-cSJE7I6c0xXnOWqEBh2Uawuw3PrqmHgcR9ArEHNKV9QL8Mp0h54jpdsmhpmyPQvKUIUi3JBGRjdgvbcu-uHyY Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:07:33.364583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_573a75f13f7240479c725daba27011bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/573a75f13f7240479c725daba27011bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 10705004cfd74f0caddef9db51f1a52c Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {"volumeAttachment": {"volumeId": "7ec58de0-ab88-4a42-a938-7823f21faedc"}} Aug 05 20:07:33.366322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Cannot 'attach_volume' instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 while it is in vm_state rescued Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'server_id': '2cfe824c-c06c-4210-8616-5c6f7331d1a2', 'body': {'volumeAttachment': {'volumeId': '7ec58de0-ab88-4a42-a938-7823f21faedc'}}} Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:07:33.367186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 while it is in vm_state rescued Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:07:33.368583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:07:33.369864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:07:33.369864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:07:33.369864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 while it is in vm_state rescued Aug 05 20:07:33.369864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.369864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Returning 409 to user: Cannot 'attach_volume' instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 while it is in vm_state rescued {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:07:33.369864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-accf6af3-0430-470d-a1ed-f4d67e31cc3e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044616 Aug 05 20:07:33.369864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 213/437] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:07:33 2022] POST /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 05 20:07:33.375959 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3aa45199-1cca-4807-971f-010fe08b3c69 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:33.376497 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3aa45199-1cca-4807-971f-010fe08b3c69 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:33.383239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3aa45199-1cca-4807-971f-010fe08b3c69 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.383719 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3aa45199-1cca-4807-971f-010fe08b3c69 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.384182 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3aa45199-1cca-4807-971f-010fe08b3c69 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.384869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3aa45199-1cca-4807-971f-010fe08b3c69 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.385478 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3aa45199-1cca-4807-971f-010fe08b3c69 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.385906 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3aa45199-1cca-4807-971f-010fe08b3c69 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.399367 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:33.399964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:33.405873 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.406358 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.406797 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.407515 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.408010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.408441 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.459367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3aa45199-1cca-4807-971f-010fe08b3c69 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2/action" status: 202 len: 0 microversion: 2.1 time: 0.087223 Aug 05 20:07:33.460048 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 225/438] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:07:33 2022] POST /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:07:33.465236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:33.465939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:33.473069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.473694 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.474142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.475042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.475537 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.475998 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.628794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:33.637712 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-44a7d42c-9374-49a4-815a-a76eb8620d42 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.176428 Aug 05 20:07:33.638324 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 226/439] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:33 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:33.643156 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:33.644324 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:33.650793 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.651533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.652002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.652718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.653174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.653598 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.787599 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:33.794288 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:33.796587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:33.798280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:33.799559 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-50d08de5-a0ea-49be-88c1-321c7ac3afc7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.404100 Aug 05 20:07:33.802964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 214/440] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:33 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:07:33.803578 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-85954d36-2130-4dd2-af30-94c50bee9446 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1511 microversion: 2.1 time: 0.164192 Aug 05 20:07:33.804185 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 227/441] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:33 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:34.355291 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:34.356094 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:34.362778 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.363273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.364485 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.365575 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.366049 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.366494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.507444 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:34.514877 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-2517eaa1-37cb-4df0-a84b-43d69ad95c57 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.163582 Aug 05 20:07:34.515656 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 215/442] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:34 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:34.658128 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:34.658730 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:34.667509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.668406 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.668845 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.672120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.672906 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.673503 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.824349 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:34.825496 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:34.832781 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.833774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.834411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.835379 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.836084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.837319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.898317 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:34.907829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f20565ac-1c6f-42c5-81b0-603ecfb67015 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.253415 Aug 05 20:07:34.909577 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 228/443] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:34 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:34.914760 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:34.915357 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:34.929622 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.930293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.930740 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.931453 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.931937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.932367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:35.058689 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:35.069528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:35.071401 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:35.073414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a1716d28-60ab-4e75-ad66-c30b42f51d1f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.252562 Aug 05 20:07:35.080346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 216/444] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:34 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:07:35.251746 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:35.260669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b1ade978-0428-4541-af01-39b6baf40225 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1511 microversion: 2.1 time: 0.349869 Aug 05 20:07:35.261468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 229/445] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:34 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:35.536230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:35.536848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:35.545630 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.545630 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.545630 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:35.546524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.547004 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.547440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:35.697947 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:35.705514 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-07b4af57-d59d-4915-89e3-fe1808ed6351 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.173162 Aug 05 20:07:35.706101 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 217/446] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:35 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:35.930233 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:35.930876 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:35.937300 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.937783 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.938219 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:35.938906 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.939359 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.939795 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.079610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:36.092175 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a315f4af-bfd4-4929-ae33-b6a9d50cc881 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.166758 Aug 05 20:07:36.092785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 230/447] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:35 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:36.096554 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:36.097193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:36.104603 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:36.105096 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:36.105537 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.106235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:36.106696 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:36.107131 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.240355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:36.249037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:36.250538 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:36.251697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e05ed950-8301-4d01-a887-8174784bf20f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.158967 Aug 05 20:07:36.252294 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 218/448] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:36 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:07:36.285694 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:36.286308 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:36.292391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:36.292880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:36.293579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.294269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:36.294726 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:36.295150 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.429918 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:36.438167 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-53657f67-b104-4f06-a0b1-6a7f8236325e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1511 microversion: 2.1 time: 0.156309 Aug 05 20:07:36.438725 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 231/449] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:36 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:36.666595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-8857ab3e-e774-419b-b9a9-8cfe559c39b2 req-8b075e06-f7a8-409b-ba51-939883a520ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49e6225-f22b-44fc-ad77-be5500dd95ca", "name": "network-vif-plugged", "status": "completed", "tag": "1bdc744a-8e2b-4857-9c57-b9ac61ab593c"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:36.678747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-8857ab3e-e774-419b-b9a9-8cfe559c39b2 req-8b075e06-f7a8-409b-ba51-939883a520ca service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:36.678747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-8857ab3e-e774-419b-b9a9-8cfe559c39b2 req-8b075e06-f7a8-409b-ba51-939883a520ca service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:36.678981 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-8857ab3e-e774-419b-b9a9-8cfe559c39b2 req-8b075e06-f7a8-409b-ba51-939883a520ca service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.693778 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-8857ab3e-e774-419b-b9a9-8cfe559c39b2 req-8b075e06-f7a8-409b-ba51-939883a520ca service nova] Creating event network-vif-plugged:1bdc744a-8e2b-4857-9c57-b9ac61ab593c for instance a49e6225-f22b-44fc-ad77-be5500dd95ca on hv-cinder-85221 Aug 05 20:07:36.698759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-8857ab3e-e774-419b-b9a9-8cfe559c39b2 req-8b075e06-f7a8-409b-ba51-939883a520ca service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036138 Aug 05 20:07:36.699350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 219/450] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:36.727251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:36.728020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:36.733947 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:36.734418 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:36.734853 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.735545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:36.736022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:36.736442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.870699 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:36.878271 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e80a3336-5af3-4503-a80e-542486045dc1 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.156045 Aug 05 20:07:36.878854 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 232/451] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:36 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:37.113202 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:37.114468 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:37.120913 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.121405 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.121843 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:37.122548 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.123007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.123434 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:37.269369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:37.276628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:37.277143 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-98de5e27-0a02-4e48-8bdc-969d525fd6d1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.168080 Aug 05 20:07:37.277243 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:37.277558 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 220/452] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:37 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:37.279540 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=18 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:37.284927 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.285412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.286391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:37.287468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.287935 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.288360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:37.461251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:37.461878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:37.468315 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.468734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.470074 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:37.470785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.471239 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.471676 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:37.490334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:37.501505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:37.503544 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:37.506330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f8216975-3efe-48bb-98f4-45e8486ebd1a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.233327 Aug 05 20:07:37.534187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 233/453] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:37 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:07:37.659848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:37.674607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-57793adc-500b-4056-8f46-4e482775fa88 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1511 microversion: 2.1 time: 0.218052 Aug 05 20:07:37.675544 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 221/454] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:37 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:37.902774 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:37.903312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:37.909727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.910212 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.910649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:37.911455 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.911949 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.912377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:38.067279 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:38.075238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fd7383f9-f4b8-4b56-a2e2-ae9999dc72a3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.178648 Aug 05 20:07:38.075836 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 234/455] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:37 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:38.297685 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:38.298301 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:38.306518 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:38.307031 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:38.307474 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:38.309192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:38.309192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:38.309192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:38.463941 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:38.471404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a9034031-0218-404f-9c6a-31e13eb284a3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.177604 Aug 05 20:07:38.471998 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 222/456] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:38 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:38.539363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:38.540791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:38.548031 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:38.548528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:38.548962 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:38.549696 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:38.550291 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:38.550737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:38.697070 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:38.697639 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:38.704046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:38.704544 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:38.704988 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:38.705879 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:38.706720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:38.707317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:38.710158 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:38.719430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:38.721573 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:38.722562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-51ad0377-91c7-4499-affa-5a94cb9352db tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.188468 Aug 05 20:07:38.724123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 235/457] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:38 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:38.871211 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:38.878600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-19b163d2-a972-4756-9b20-10fa8bafdbd4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1511 microversion: 2.1 time: 0.185962 Aug 05 20:07:38.879168 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 223/458] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:38 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:39.096799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:39.097371 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:39.100493 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:39.105493 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.105980 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.106412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.107102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.107554 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.108003 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.252201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:39.260372 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0e3921fa-e19a-46d3-ba32-42c1105cb341 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.167609 Aug 05 20:07:39.260943 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 236/459] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:39 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:39.493035 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:39.493625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:39.500071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.500552 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.500983 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.501664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.502114 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.502534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.647085 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:39.656791 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-262bf058-510b-4821-b754-ee32412e0338 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.168065 Aug 05 20:07:39.657497 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 224/460] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:39 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:39.746538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:39.747140 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:39.755261 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.756012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.756589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.757980 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.758749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.759371 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.895016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:39.899530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:39.900092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:39.904869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:39.905815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.906304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.906435 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:39.906743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.907448 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.907556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d9f2b9f4-caf5-4cf9-9f55-c6c896d73cfa tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.164911 Aug 05 20:07:39.907946 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.908145 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 237/461] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:39 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:39.908378 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.046019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:40.059580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d43b7216-1ea0-48e9-b183-96a138ae09b7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1511 microversion: 2.1 time: 0.164570 Aug 05 20:07:40.060614 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 225/462] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:39 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:40.282664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:40.283361 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:40.292318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:40.292817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:40.293522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.294231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:40.294689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:40.295120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.438217 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:40.446385 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e88636a3-1c93-41ab-bb4d-6eebe71f8a45 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.167711 Aug 05 20:07:40.446952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 238/463] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:40 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:40.679128 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:40.680256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:40.686747 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:40.687231 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:40.687659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.688519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:40.689135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:40.689674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.701007 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-10770b41-b1eb-44b4-a5a2-4af0c6b4bc6c req-a4cdbf21-dd20-4a00-b7a5-95d579c8ff12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0de831f-1cb5-4286-9c10-0fb614962af7", "name": "network-vif-plugged", "status": "completed", "tag": "5a74e867-0a99-4c52-83b6-7c2e357cf53f"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:40.716680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-10770b41-b1eb-44b4-a5a2-4af0c6b4bc6c req-a4cdbf21-dd20-4a00-b7a5-95d579c8ff12 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:40.717427 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-10770b41-b1eb-44b4-a5a2-4af0c6b4bc6c req-a4cdbf21-dd20-4a00-b7a5-95d579c8ff12 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:40.717767 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-10770b41-b1eb-44b4-a5a2-4af0c6b4bc6c req-a4cdbf21-dd20-4a00-b7a5-95d579c8ff12 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.734320 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-10770b41-b1eb-44b4-a5a2-4af0c6b4bc6c req-a4cdbf21-dd20-4a00-b7a5-95d579c8ff12 service nova] Creating event network-vif-plugged:5a74e867-0a99-4c52-83b6-7c2e357cf53f for instance b0de831f-1cb5-4286-9c10-0fb614962af7 on hv-cinder-85221 Aug 05 20:07:40.741395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-10770b41-b1eb-44b4-a5a2-4af0c6b4bc6c req-a4cdbf21-dd20-4a00-b7a5-95d579c8ff12 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043350 Aug 05 20:07:40.742163 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 239/464] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:07:40.837756 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:40.845346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f4fc2e31-d4da-41c1-8f69-a072887a2e02 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.170905 Aug 05 20:07:40.845917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 226/465] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:40 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:40.932680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:40.933373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:40.939561 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:40.940094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:40.940532 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.941335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:40.941973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:40.942406 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.957075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:41.078835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:41.082300 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:41.083964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:41.089816 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:41.089991 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:41.090479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:41.090918 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:41.091246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:41.091649 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:41.092138 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:41.092461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c78852d3-addc-470b-9f58-2126fb18ab09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.164888 Aug 05 20:07:41.092608 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:41.093014 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 240/466] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:40 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:07:41.241690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:41.248453 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6f10bcd4-fd26-438c-9341-8e456301f3b1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1511 microversion: 2.1 time: 0.170181 Aug 05 20:07:41.249040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 227/467] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:41 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:41.466618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:41.467243 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:41.474166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:41.475056 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:41.475898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:41.476632 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:41.477143 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:41.477763 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:41.633032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:41.640571 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2a074ac1-e173-4e01-8f91-0e706924d69b tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.177765 Aug 05 20:07:41.641419 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 241/468] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:41 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:41.868833 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:41.868833 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:41.877648 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:41.878303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:41.879105 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:41.880266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:41.880787 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:41.881219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.022807 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:42.030396 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8df38131-6835-4191-bb05-e150af72e444 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.167790 Aug 05 20:07:42.030961 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 228/469] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:41 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:42.119815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:42.120487 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:42.126766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:42.127264 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:42.127705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.128438 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:42.128895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:42.129335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.270494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:42.271119 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:42.277425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:42.277940 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:42.278375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.279103 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:42.279557 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:42.280066 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.282653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:42.292996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:42.295208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:42.296411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c9a2be47-0d23-464b-9b0f-e6482c252f78 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1808 microversion: 2.20 time: 0.180876 Aug 05 20:07:42.296980 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 242/470] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:42 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:42.419999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:42.428308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6d973b45-05ba-4ab5-80cd-948bdbddb3a1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1517 microversion: 2.1 time: 0.161935 Aug 05 20:07:42.428902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 229/471] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:42 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:42.662297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:42.663015 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:42.674257 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:42.674755 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:42.675594 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.677602 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:42.678224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:42.679402 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.827704 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:42.836166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-abaacdc7-79e3-44df-a6c6-94b6ef0616a7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.178689 Aug 05 20:07:42.836727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 243/472] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:42 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:43.052054 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:43.052755 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:43.058588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.059069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.059501 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:43.060219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.060665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.061095 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:43.193050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:43.200470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e0b4c36e-66c8-43c0-a9f1-234683d943a7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.153022 Aug 05 20:07:43.201042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 230/473] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:43 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:43.320191 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:43.320705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:43.326689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.327171 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.327608 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:43.328332 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.328784 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.329209 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:43.462403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:43.470807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:43.472344 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:43.474045 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c98352e6-57bb-4d1c-9d66-494bc7c92355 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1795 microversion: 2.20 time: 0.157955 Aug 05 20:07:43.474604 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 244/474] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:07:43 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:07:43.788518 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-58031497-bd02-4111-b462-86cd7b28e8ad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'create', calling method: .version_select at 0x7f5691e06940>, body: {"keypair": {"name": "tempest-keypair-744127628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ+HGyg6tjQknweR+52ZRw/RcUZFfEErJjZr+mk5qWymim40pqFihm6Rns8BJL9+NCzHzQfrr1A8nYuypyO+Rv5MHCHohKD4bYE4309+zlDXk+V7G2f/KA95apKPL4f2A=="}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:43.804431 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-58031497-bd02-4111-b462-86cd7b28e8ad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Getting quotas for project 573a75f13f7240479c725daba27011bf. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:43.808333 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-58031497-bd02-4111-b462-86cd7b28e8ad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Getting quotas for user 10705004cfd74f0caddef9db51f1a52c and project 573a75f13f7240479c725daba27011bf. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:43.831304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-58031497-bd02-4111-b462-86cd7b28e8ad tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047310 Aug 05 20:07:43.831921 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 231/475] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:07:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:43.856769 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:43.857391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:43.864609 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.865344 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.865848 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:43.867590 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.868083 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.868745 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:44.144724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:44.155749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-715f8fbb-f3ac-449d-8cde-84dabee3bfe7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.302673 Aug 05 20:07:44.156334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 245/476] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:43 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:44.220362 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:44.221229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:44.227890 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:44.228386 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:44.228833 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:44.229539 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:44.230000 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:44.230544 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:44.235954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:44.373447 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:44.382417 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-994a07b2-e233-4736-8249-df855d8564e8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.165944 Aug 05 20:07:44.383121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 232/477] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:44 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:45.177795 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:45.178432 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:45.185089 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:45.185580 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:45.186016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:45.186709 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:45.187165 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:45.187591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:45.391681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:45.401932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a21a1554-003f-40bb-9973-6cbd1dec1254 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1319 microversion: 2.1 time: 0.228942 Aug 05 20:07:45.402682 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 246/478] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:45 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:45.415625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:45.420853 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:45.423639 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:45.424391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:45.424833 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:45.425679 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:45.426816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:45.427436 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:45.599688 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:45.609282 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9ae49ef0-04ed-495d-8e87-ce7b5846f485 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.208230 Aug 05 20:07:45.609897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 233/479] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:45 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:45.621890 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1970015072", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a348301-19a8-4718-a04c-ae563d7e7361"}], "security_groups": [{"name": "tempest-securitygroup--1015726027"}], "key_name": "tempest-keypair-744127628", "user_data": "}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:45.729033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] validate_networks() for [('6a348301-19a8-4718-a04c-ae563d7e7361', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:07:46.107628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:07:46.108259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:07:46.108835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:07:46.109253 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:07:46.109685 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:07:46.118617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.119094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.119528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:46.120284 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.120739 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.121164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:46.138959 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Getting quotas for project 573a75f13f7240479c725daba27011bf. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:46.142844 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Getting quotas for user 10705004cfd74f0caddef9db51f1a52c and project 573a75f13f7240479c725daba27011bf. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:46.154376 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:07:46.156670 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:07:46.202804 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6185023b-8ed0-417f-b3f2-a5567742b542 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.585668 Aug 05 20:07:46.203468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 247/480] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:07:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:07:46.214851 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9c12927d-0efc-4a7d-8f79-fdd79c9ff6b8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:46.215460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9c12927d-0efc-4a7d-8f79-fdd79c9ff6b8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:46.218389 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:46.274822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9c12927d-0efc-4a7d-8f79-fdd79c9ff6b8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:46.281494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9c12927d-0efc-4a7d-8f79-fdd79c9ff6b8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1245 microversion: 2.1 time: 0.070529 Aug 05 20:07:46.282308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 234/481] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:46 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:46.422986 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:46.424052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:46.432199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.432801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.433133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:46.433935 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.434499 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.435007 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:46.576490 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:46.585239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4bba2d5a-44bd-4c90-ac99-8c484f7c3605 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1507 microversion: 2.1 time: 0.166298 Aug 05 20:07:46.585890 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 248/482] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:46 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:46.631110 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:46.631725 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:46.638156 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.638642 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.639077 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:46.639766 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.640243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.640665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:46.794766 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:46.810129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-404a8a4c-64e9-48e7-9dd9-f39167e91670 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.182404 Aug 05 20:07:46.810828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 235/483] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:46 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:47.142645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-97c1a59b-99d7-4973-86a6-f9a8ec20fc80 req-98eb42f5-c909-4b8d-a17a-aef2d3c3ef2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e532dd-0c95-4d65-9f31-a698bdfdf52f", "name": "network-vif-plugged", "status": "completed", "tag": "1a52d740-fd7b-4b85-b351-dfbb3497a9af"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:47.153119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-97c1a59b-99d7-4973-86a6-f9a8ec20fc80 req-98eb42f5-c909-4b8d-a17a-aef2d3c3ef2c service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:47.153602 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-97c1a59b-99d7-4973-86a6-f9a8ec20fc80 req-98eb42f5-c909-4b8d-a17a-aef2d3c3ef2c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:47.154038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-97c1a59b-99d7-4973-86a6-f9a8ec20fc80 req-98eb42f5-c909-4b8d-a17a-aef2d3c3ef2c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:47.166298 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-97c1a59b-99d7-4973-86a6-f9a8ec20fc80 req-98eb42f5-c909-4b8d-a17a-aef2d3c3ef2c service nova] Creating event network-vif-plugged:1a52d740-fd7b-4b85-b351-dfbb3497a9af for instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f on hv-cinder-85221 Aug 05 20:07:47.171283 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-97c1a59b-99d7-4973-86a6-f9a8ec20fc80 req-98eb42f5-c909-4b8d-a17a-aef2d3c3ef2c service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032347 Aug 05 20:07:47.171915 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 249/484] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:47.303247 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:47.303754 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:47.309802 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:47.310290 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:47.310731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:47.311424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:47.311914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:47.312345 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:47.375318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:47.382816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b267c4fa-1d18-4424-b5cc-17bab55e5749 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1297 microversion: 2.1 time: 0.084730 Aug 05 20:07:47.383373 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 236/485] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:47 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:47.835508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:47.836809 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:47.843882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:47.844368 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:47.844799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:47.845491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:47.846117 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:47.846539 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:48.056168 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:48.063545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-239bea4d-7764-4f16-b0d3-d19e04753851 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.233486 Aug 05 20:07:48.064205 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 250/486] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:47 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:48.404522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:48.405137 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:48.412528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:48.413012 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:48.413448 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:48.414199 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:48.414780 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:48.415226 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:48.497483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:48.505681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ad408e1e-93ec-43ce-8e96-54ebfb7c3bce tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1303 microversion: 2.1 time: 0.104315 Aug 05 20:07:48.506257 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 237/487] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:48 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:49.083629 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:49.084322 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:49.090587 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:49.091077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:49.091514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:49.092247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:49.092708 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:49.093133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:49.303429 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:49.312818 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9dc673ba-3741-444f-ae12-94faa706d0cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.233180 Aug 05 20:07:49.313403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 251/488] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:49 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:49.527135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:49.527861 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:49.534221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:49.534774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:49.535298 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:49.536106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:49.536567 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:49.537121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:49.705686 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:49.719601 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9ac0857a-3f9b-4405-afbd-fe8bc387ed10 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1371 microversion: 2.1 time: 0.196469 Aug 05 20:07:49.720791 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 238/489] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:49 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:50.079656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-ff5f37f1-e16a-4217-b325-8635f3e54d05 req-385be2c9-b25a-463d-9d37-62a54a82f781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855b7a0d-cc32-490d-90c5-abb6c7b3a67b", "tag": "91cdb80d-7a07-4414-bbf0-8444ba9df127"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:50.090561 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-ff5f37f1-e16a-4217-b325-8635f3e54d05 req-385be2c9-b25a-463d-9d37-62a54a82f781 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:50.091191 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-ff5f37f1-e16a-4217-b325-8635f3e54d05 req-385be2c9-b25a-463d-9d37-62a54a82f781 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:50.091455 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-ff5f37f1-e16a-4217-b325-8635f3e54d05 req-385be2c9-b25a-463d-9d37-62a54a82f781 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:50.103498 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-ff5f37f1-e16a-4217-b325-8635f3e54d05 req-385be2c9-b25a-463d-9d37-62a54a82f781 service nova] Creating event network-changed:91cdb80d-7a07-4414-bbf0-8444ba9df127 for instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b on hv-cinder-85221 Aug 05 20:07:50.108298 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-ff5f37f1-e16a-4217-b325-8635f3e54d05 req-385be2c9-b25a-463d-9d37-62a54a82f781 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032272 Aug 05 20:07:50.108969 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 252/490] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:50.335197 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:50.335754 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:50.341684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:50.342166 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:50.342603 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:50.343288 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:50.343739 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:50.344324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:50.487414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:50.495647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-74e70708-3dc9-4923-b932-da8fae1c670b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1260 microversion: 2.1 time: 0.165039 Aug 05 20:07:50.496252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 239/491] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:50 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:50.743750 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:50.744464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:50.750530 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:50.751014 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:50.751446 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:50.752157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:50.752665 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:50.753089 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:50.899944 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:50.907437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-46a62f6e-6639-4af1-a9b0-a1589f6c49e8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1371 microversion: 2.1 time: 0.169801 Aug 05 20:07:50.908108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 253/492] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:50 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:50.967229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-615945212", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1260976200", "security_groups": [{"name": "tempest-secgroup-smoke-1644851318"}], "block_device_mapping_v2": [{"uuid": "2489de51-75a0-432d-955e-71c7fafad18f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94116f7c-4077-445f-95b2-b2800adb5e8b"}]}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:51.088280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.network.neutron [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] validate_networks() for [('94116f7c-4077-445f-95b2-b2800adb5e8b', None, None, None, None, None)] {{(pid=118175) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:07:51.489931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Flavor limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:07:51.490547 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Image limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:07:51.491023 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Flavor pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:07:51.491915 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Image pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:07:51.492527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:07:51.502166 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.502598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.503063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.504090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.504556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.505171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.515455 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:51.516085 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:51.523297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.523468 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Getting quotas for project b0ab093edb944772ae7b6fd285178a43. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:51.523801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.524249 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.524953 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.525436 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.526059 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.527619 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Getting quotas for user 6f89a5e4981e423b84d5f28b33bd9629 and project b0ab093edb944772ae7b6fd285178a43. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:51.589392 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Going to run 1 instances... {{(pid=118175) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:07:51.591481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2489de51-75a0-432d-955e-71c7fafad18f',volume_size=None,volume_type=None)] {{(pid=118175) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:07:51.731729 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-69fd6c4c-e424-420c-b130-51e146eab0bc tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.768787 Aug 05 20:07:51.732974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 240/493] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:07:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:07:51.745893 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1ff91e16-8529-465a-8db9-33376968c2b2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:51.746848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1ff91e16-8529-465a-8db9-33376968c2b2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:51.756030 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:51.796116 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fff0b560-9b72-4fad-8db1-d19ef548589a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1444 microversion: 2.1 time: 0.284009 Aug 05 20:07:51.797787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 254/494] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:51 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1444 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:51.823249 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:51.824771 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:51.827594 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1ff91e16-8529-465a-8db9-33376968c2b2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:51.837331 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1ff91e16-8529-465a-8db9-33376968c2b2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1094 microversion: 2.1 time: 0.096533 Aug 05 20:07:51.838225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 241/495] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:51 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:51.838713 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.839674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.840491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.842082 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.843056 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.843792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.932878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:51.933878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:51.940854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.941455 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.941915 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.942957 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.943322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.944127 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:52.014244 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:52.022725 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-39ef27ec-ca15-4d4f-8c47-94f8e006f864 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1444 microversion: 2.1 time: 0.207535 Aug 05 20:07:52.023488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 255/496] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:51 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1444 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:52.099217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:52.107704 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3a801dd1-acc6-4ee9-ac8b-2ada17363a58 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1371 microversion: 2.1 time: 0.179188 Aug 05 20:07:52.108505 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 242/497] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:51 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:52.858597 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:52.859285 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:52.868404 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:52.869070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:52.869765 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:52.870688 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:52.875506 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:52.876246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:52.945762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:52.953555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-100931c0-b2be-4140-90f9-67f80f960171 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1144 microversion: 2.1 time: 0.098918 Aug 05 20:07:52.954120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 256/498] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:52 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:53.128637 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:53.129256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:53.136312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:53.136805 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:53.137312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:53.138019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:53.138481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:53.138912 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:53.345726 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:53.356466 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a85b23da-5ecb-4694-aa6c-c3a7d165d471 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1371 microversion: 2.1 time: 0.231838 Aug 05 20:07:53.357045 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 243/499] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:53 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:53.947281 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-5c6bfd52-7d29-4659-91a3-a14efb31d4f3 req-700a36d9-e82c-4a02-8bc1-e5f07de54b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e532dd-0c95-4d65-9f31-a698bdfdf52f", "tag": "1a52d740-fd7b-4b85-b351-dfbb3497a9af"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:53.958688 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-5c6bfd52-7d29-4659-91a3-a14efb31d4f3 req-700a36d9-e82c-4a02-8bc1-e5f07de54b01 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:53.959163 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-5c6bfd52-7d29-4659-91a3-a14efb31d4f3 req-700a36d9-e82c-4a02-8bc1-e5f07de54b01 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:53.959590 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-5c6bfd52-7d29-4659-91a3-a14efb31d4f3 req-700a36d9-e82c-4a02-8bc1-e5f07de54b01 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:53.972773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-5c6bfd52-7d29-4659-91a3-a14efb31d4f3 req-700a36d9-e82c-4a02-8bc1-e5f07de54b01 service nova] Creating event network-changed:1a52d740-fd7b-4b85-b351-dfbb3497a9af for instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f on hv-cinder-85221 Aug 05 20:07:53.974478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:53.975191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:53.977663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-5c6bfd52-7d29-4659-91a3-a14efb31d4f3 req-700a36d9-e82c-4a02-8bc1-e5f07de54b01 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034566 Aug 05 20:07:53.978313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 257/500] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:07:53.985037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:53.985516 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:53.985954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:53.986652 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:53.987103 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:53.987524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:54.056743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:54.064027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-113911f2-bcaf-4471-a8e3-7efaa7395320 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1192 microversion: 2.1 time: 0.093870 Aug 05 20:07:54.064598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 244/501] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:53 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:54.378422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:54.379130 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:54.386132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:54.386637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:54.387065 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:54.387769 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:54.388248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:54.388680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:54.719081 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:54.731805 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0c415d1a-f1ed-427a-9e7b-e561a7875f46 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1371 microversion: 2.1 time: 0.357609 Aug 05 20:07:54.732750 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 258/502] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:54 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:55.091613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:55.092394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:55.100963 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:55.101763 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:55.102416 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:55.103716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:55.104445 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:55.105154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:55.180795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:55.191318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b67a5ebb-0250-4679-a618-608f0b9fada3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1210 microversion: 2.1 time: 0.103463 Aug 05 20:07:55.193113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 245/503] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:55 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:55.755725 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:55.756537 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:55.764336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:55.764971 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:55.765508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:55.766461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:55.767469 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:55.768016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:55.958709 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:55.961708 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:55.968204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4a3e7ba8-cd6c-4622-8bbd-645802938bb2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1371 microversion: 2.1 time: 0.216328 Aug 05 20:07:55.969151 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 259/504] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:55 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:56.217379 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:56.218162 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:56.224630 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:56.225121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:56.225557 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:56.226264 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:56.226856 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:56.227285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:56.366214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:56.374240 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7cf81917-3244-4ed7-8196-f9d15c9fa013 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.160944 Aug 05 20:07:56.374987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 246/505] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:56 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:56.728246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-1ef954f9-c9c4-4755-be3f-aff295358ab6 req-ad4920b7-6a72-4d10-8451-a55d3381d6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1af2142-ec43-40b7-b612-0ba54aba802a", "tag": "40a30526-22e8-498f-88ef-1351df155391"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:56.733303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:56.734170 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=6 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:56.742206 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-1ef954f9-c9c4-4755-be3f-aff295358ab6 req-ad4920b7-6a72-4d10-8451-a55d3381d6fe service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:56.742700 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-1ef954f9-c9c4-4755-be3f-aff295358ab6 req-ad4920b7-6a72-4d10-8451-a55d3381d6fe service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:56.743137 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-1ef954f9-c9c4-4755-be3f-aff295358ab6 req-ad4920b7-6a72-4d10-8451-a55d3381d6fe service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:56.755634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-1ef954f9-c9c4-4755-be3f-aff295358ab6 req-ad4920b7-6a72-4d10-8451-a55d3381d6fe service nova] Creating event network-changed:40a30526-22e8-498f-88ef-1351df155391 for instance e1af2142-ec43-40b7-b612-0ba54aba802a on hv-cinder-85221 Aug 05 20:07:56.760319 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-1ef954f9-c9c4-4755-be3f-aff295358ab6 req-ad4920b7-6a72-4d10-8451-a55d3381d6fe service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035745 Aug 05 20:07:56.761085 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 260/506] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:56.990608 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:56.991346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:56.997838 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:56.998325 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:56.998895 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:56.999600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:57.000110 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:57.000540 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:57.145733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:57.154832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-48ef78c4-7b54-4e22-9034-739e4edc3956 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1371 microversion: 2.1 time: 0.168006 Aug 05 20:07:57.160398 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 247/507] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:56 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:57.294090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-fd608e79-6e65-4a7d-8a86-af805de75dc6 req-97af5052-c505-4dbd-bb96-fc0638143967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "855b7a0d-cc32-490d-90c5-abb6c7b3a67b", "name": "network-vif-plugged", "status": "completed", "tag": "91cdb80d-7a07-4414-bbf0-8444ba9df127"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:57.305082 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-fd608e79-6e65-4a7d-8a86-af805de75dc6 req-97af5052-c505-4dbd-bb96-fc0638143967 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:57.305524 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-fd608e79-6e65-4a7d-8a86-af805de75dc6 req-97af5052-c505-4dbd-bb96-fc0638143967 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:57.305961 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-fd608e79-6e65-4a7d-8a86-af805de75dc6 req-97af5052-c505-4dbd-bb96-fc0638143967 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:57.318381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-fd608e79-6e65-4a7d-8a86-af805de75dc6 req-97af5052-c505-4dbd-bb96-fc0638143967 service nova] Creating event network-vif-plugged:91cdb80d-7a07-4414-bbf0-8444ba9df127 for instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b on hv-cinder-85221 Aug 05 20:07:57.323471 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-fd608e79-6e65-4a7d-8a86-af805de75dc6 req-97af5052-c505-4dbd-bb96-fc0638143967 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034188 Aug 05 20:07:57.324112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 261/508] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:57.395921 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:57.396532 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:57.402882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:57.403370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:57.403862 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:57.404558 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:57.405015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:57.405443 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:57.555032 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:57.562674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-67b07c67-ba45-4d88-8697-62aced190316 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.170826 Aug 05 20:07:57.563279 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 248/509] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:57 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:58.182411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:58.183113 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:58.189250 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:58.189735 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:58.190174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:58.190863 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:58.191316 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:58.192470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:58.331658 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:58.339072 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9634668e-5fa9-4261-a1d1-2874f04e3ec3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1371 microversion: 2.1 time: 0.160837 Aug 05 20:07:58.339630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 262/510] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:58 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:58.584402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:58.585039 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:58.591804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:58.592322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:58.592766 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:58.593470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:58.593929 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:58.594354 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:58.741347 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:58.749112 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7f6fc8bd-f561-4b71-9fe4-2896f40a3a65 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.169305 Aug 05 20:07:58.749680 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 249/511] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:58 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:59.361460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:59.362913 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:59.371377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:59.372400 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:59.372911 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:59.373691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:59.374249 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:59.374743 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:59.512761 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:59.520736 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-640deee8-7af0-462c-8270-5360ea333d67 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1371 microversion: 2.1 time: 0.163069 Aug 05 20:07:59.521448 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 263/512] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:59 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:59.772878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:59.773522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:59.779937 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:59.780428 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:59.780872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:59.781566 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:59.782022 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:59.782446 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:59.920882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:59.928466 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c63d5698-14ce-4de9-a257-1f3f973a68b6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.160322 Aug 05 20:07:59.929029 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 250/513] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:59 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:00.541930 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:00.542536 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:00.549728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.550303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.550862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:00.552261 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.552745 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.553252 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:00.695278 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:00.703192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8a54923e-3f0f-4fb9-a70a-066a90f5d390 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1565 microversion: 2.1 time: 0.165037 Aug 05 20:08:00.703894 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 264/514] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:00 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:00.724654 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-aa393088-8071-42cc-a65c-d839e8268951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:00.725141 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-aa393088-8071-42cc-a65c-d839e8268951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:00.731044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa393088-8071-42cc-a65c-d839e8268951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.731524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa393088-8071-42cc-a65c-d839e8268951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.732015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa393088-8071-42cc-a65c-d839e8268951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:00.732708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa393088-8071-42cc-a65c-d839e8268951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.733163 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa393088-8071-42cc-a65c-d839e8268951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.733590 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aa393088-8071-42cc-a65c-d839e8268951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:00.750838 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:00.819190 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-aa393088-8071-42cc-a65c-d839e8268951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099016 Aug 05 20:08:00.819819 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 251/515] 10.222.0.95 () {58 vars in 1275 bytes} [Fri Aug 5 20:08:00 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:00.948686 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:00.949237 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:00.955641 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.956502 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.957226 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:00.958915 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.959542 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.960158 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:01.235004 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:01.242829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-14d7b3d2-47e6-4cc2-b347-a9af44c023fa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.297937 Aug 05 20:08:01.243502 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 265/516] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:00 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:02.275138 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:02.275952 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:02.277724 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:02.278977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=14 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:02.285025 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:02.286015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:02.286460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:02.287348 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:02.287820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:02.288244 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:02.376174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-886b57b8-7c2d-4056-88dc-e5c4d9e184da req-4f3265be-8b7e-4d2b-be75-e1e67c0c7b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855b7a0d-cc32-490d-90c5-abb6c7b3a67b", "tag": "91cdb80d-7a07-4414-bbf0-8444ba9df127"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:02.393500 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-886b57b8-7c2d-4056-88dc-e5c4d9e184da req-4f3265be-8b7e-4d2b-be75-e1e67c0c7b17 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:02.394616 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-886b57b8-7c2d-4056-88dc-e5c4d9e184da req-4f3265be-8b7e-4d2b-be75-e1e67c0c7b17 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:02.396131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-886b57b8-7c2d-4056-88dc-e5c4d9e184da req-4f3265be-8b7e-4d2b-be75-e1e67c0c7b17 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:02.412290 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-886b57b8-7c2d-4056-88dc-e5c4d9e184da req-4f3265be-8b7e-4d2b-be75-e1e67c0c7b17 service nova] Creating event network-changed:91cdb80d-7a07-4414-bbf0-8444ba9df127 for instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b on hv-cinder-85221 Aug 05 20:08:02.418088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-886b57b8-7c2d-4056-88dc-e5c4d9e184da req-4f3265be-8b7e-4d2b-be75-e1e67c0c7b17 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045872 Aug 05 20:08:02.418915 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 266/517] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:02.440880 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:02.449330 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ba56969e-705a-470f-9e96-fd006609a0fd tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.181029 Aug 05 20:08:02.450198 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 252/518] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:02 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:03.471443 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:03.472272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:03.479398 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:03.479933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:03.480377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:03.481080 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:03.481535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:03.481962 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:03.639630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:03.647606 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-83925c97-7e87-4e9c-b1b1-0ab4b2cf8c4b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.180870 Aug 05 20:08:03.648297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 267/519] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:03 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:04.670246 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:04.670864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:04.678064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:04.678545 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:04.678976 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:04.679806 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:04.680357 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:04.680917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:05.050679 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:05.058913 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a08c38f0-844e-4367-a33c-513f64fb4863 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.393720 Aug 05 20:08:05.059477 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 253/520] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:04 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:06.080279 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:06.080899 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:06.088405 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:06.088898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:06.089355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:06.090073 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:06.090529 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:06.091023 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:06.229797 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:06.237347 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-55a467b9-58c3-4a50-b23d-c5b28ca1272c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.162395 Aug 05 20:08:06.237908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 268/521] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:06 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:07.257677 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:07.258270 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:07.264738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:07.265222 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:07.265663 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:07.266357 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:07.266815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:07.267243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:07.397931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:07.406422 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-aad7200d-7a97-412e-a3dd-23995d37ea08 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.152877 Aug 05 20:08:07.406989 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 254/522] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:07 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:07.722239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-a0455978-87c6-4618-bb1d-2d3ad62451c6 req-d562b1b0-67af-4278-b3d2-3b27ebdad555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1af2142-ec43-40b7-b612-0ba54aba802a", "name": "network-vif-plugged", "status": "completed", "tag": "40a30526-22e8-498f-88ef-1351df155391"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:07.734664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-a0455978-87c6-4618-bb1d-2d3ad62451c6 req-d562b1b0-67af-4278-b3d2-3b27ebdad555 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:07.735157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-a0455978-87c6-4618-bb1d-2d3ad62451c6 req-d562b1b0-67af-4278-b3d2-3b27ebdad555 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:07.735592 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-a0455978-87c6-4618-bb1d-2d3ad62451c6 req-d562b1b0-67af-4278-b3d2-3b27ebdad555 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:07.747712 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-a0455978-87c6-4618-bb1d-2d3ad62451c6 req-d562b1b0-67af-4278-b3d2-3b27ebdad555 service nova] Creating event network-vif-plugged:40a30526-22e8-498f-88ef-1351df155391 for instance e1af2142-ec43-40b7-b612-0ba54aba802a on hv-cinder-85221 Aug 05 20:08:07.752889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-a0455978-87c6-4618-bb1d-2d3ad62451c6 req-d562b1b0-67af-4278-b3d2-3b27ebdad555 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034429 Aug 05 20:08:07.753843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 269/523] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:08.428753 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:08.429458 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:08.435622 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:08.436141 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:08.436575 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:08.437263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:08.437715 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:08.438139 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:08.574852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:08.582335 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-55ba62a9-9b6c-4c5c-8ec5-0d0be43b2255 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.157650 Aug 05 20:08:08.582899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 255/524] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:08 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:09.608754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:09.609555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:09.612285 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:09.619142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:09.620036 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:09.620630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:09.621951 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:09.622784 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:09.623353 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:09.781746 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:09.790085 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3c76a801-c262-4514-bdb1-1a32423909aa tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.188386 Aug 05 20:08:09.790658 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 270/525] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:09 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:10.391684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-768643fd-91ab-464a-ab46-0cc38e726b8d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd9351d6-3aa7-4531-8b05-695f2154c0d4", "device": "/dev/sdb"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:10.394608 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-768643fd-91ab-464a-ab46-0cc38e726b8d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:10.401815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-768643fd-91ab-464a-ab46-0cc38e726b8d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:10.402303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-768643fd-91ab-464a-ab46-0cc38e726b8d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:10.402740 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-768643fd-91ab-464a-ab46-0cc38e726b8d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:10.403429 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-768643fd-91ab-464a-ab46-0cc38e726b8d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:10.403922 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-768643fd-91ab-464a-ab46-0cc38e726b8d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:10.404345 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-768643fd-91ab-464a-ab46-0cc38e726b8d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:10.716549 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-768643fd-91ab-464a-ab46-0cc38e726b8d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "POST /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328617 Aug 05 20:08:10.717218 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 256/526] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:08:10 2022] POST /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:10.811757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:10.812403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:10.818912 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:10.819400 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:10.819865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:10.820560 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:10.821020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:10.822101 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:10.961109 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:10.968764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c8114842-6e69-43e8-a33f-cda5c71e2a87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.160915 Aug 05 20:08:10.969332 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 271/527] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:10 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:11.996062 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:11.997117 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:12.004613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:12.005131 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:12.005569 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:12.006271 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:12.006728 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:12.007154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:12.139860 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:12.147315 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-243001fc-cbdd-4da4-8ba1-6338fb3c67ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1266 microversion: 2.1 time: 0.158204 Aug 05 20:08:12.147892 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 257/528] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:11 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:13.169482 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:13.170393 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:13.177165 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:13.177654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:13.178090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:13.178790 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:13.179242 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:13.179667 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:13.317229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:13.325088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-dfafc963-e986-46b9-b581-5cadb5373fd3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1453 microversion: 2.1 time: 0.160381 Aug 05 20:08:13.325652 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 272/529] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:13 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:13.345161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:13.345771 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:13.352291 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:13.352774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:13.353848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:13.354547 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:13.354996 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:13.355417 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:13.488860 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:13.496681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-92b1d658-e1b1-4e3f-a196-956536266238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1453 microversion: 2.1 time: 0.155272 Aug 05 20:08:13.497246 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 258/530] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:13 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:15.397232 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-e580df54-fc86-4104-a180-68a1c8828509 req-0b4df058-3faa-470a-a921-da5f67039b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1af2142-ec43-40b7-b612-0ba54aba802a", "tag": "40a30526-22e8-498f-88ef-1351df155391"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:15.407867 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-e580df54-fc86-4104-a180-68a1c8828509 req-0b4df058-3faa-470a-a921-da5f67039b12 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:15.408355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-e580df54-fc86-4104-a180-68a1c8828509 req-0b4df058-3faa-470a-a921-da5f67039b12 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:15.408789 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-e580df54-fc86-4104-a180-68a1c8828509 req-0b4df058-3faa-470a-a921-da5f67039b12 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:15.425484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-e580df54-fc86-4104-a180-68a1c8828509 req-0b4df058-3faa-470a-a921-da5f67039b12 service nova] Creating event network-changed:40a30526-22e8-498f-88ef-1351df155391 for instance e1af2142-ec43-40b7-b612-0ba54aba802a on hv-cinder-85221 Aug 05 20:08:15.432863 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-e580df54-fc86-4104-a180-68a1c8828509 req-0b4df058-3faa-470a-a921-da5f67039b12 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039132 Aug 05 20:08:15.433733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 273/531] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:33.394699 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:33.395229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:33.397873 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:33.398542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:33.405910 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:33.406403 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:33.406846 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:33.407547 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:33.408037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:33.408482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:33.541026 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lazy-loading 'services' on Instance uuid b0de831f-1cb5-4286-9c10-0fb614962af7 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:33.663227 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-079602f4-fbf6-4aa6-bfb9-034a631de7c7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "DELETE /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7/os-volume_attachments/cd9351d6-3aa7-4531-8b05-695f2154c0d4" status: 202 len: 0 microversion: 2.1 time: 0.272231 Aug 05 20:08:33.663851 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 259/532] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:08:33 2022] DELETE /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7/os-volume_attachments/cd9351d6-3aa7-4531-8b05-695f2154c0d4 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:08:35.847067 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=7 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:35.847840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=65 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:35.852310 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:35.852995 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:35.859896 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:35.860380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:35.860813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:35.861498 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:35.861951 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:35.862373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:35.889131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Going to try to terminate instance {{(pid=118174) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:08:35.981437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f90f2a5f-187b-4aba-8d34-a97c7c65ed33 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "DELETE /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 204 len: 0 microversion: 2.1 time: 0.135542 Aug 05 20:08:35.982140 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 274/533] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:08:35 2022] DELETE /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:08:35.991504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:35.992238 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:35.998975 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:35.999505 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:35.999989 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:36.000695 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:36.001149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:36.001582 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:36.134928 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:36.142336 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c5f90e6f-0e52-4b64-80e2-a31d35b2d7e7 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1513 microversion: 2.1 time: 0.155560 Aug 05 20:08:36.142948 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 260/534] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:35 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:37.163116 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:37.163865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:37.171245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:37.171729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:37.172214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:37.172880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:37.173329 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:37.173752 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:37.304022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:37.311749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2c943798-8af5-47f8-8ba0-67c67e64fcc2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1513 microversion: 2.1 time: 0.152811 Aug 05 20:08:37.312340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 275/535] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:37 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:38.334825 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:38.335435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:38.343182 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:38.343664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:38.344198 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:38.344888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:38.345338 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:38.345775 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:38.476889 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:38.484976 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-11435e48-946f-4246-9ab1-1f42b33103ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1513 microversion: 2.1 time: 0.154614 Aug 05 20:08:38.485546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 261/536] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:38 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:39.506534 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:39.507147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:39.513542 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.514033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.514473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.515165 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.515624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.516087 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.536112 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e7a16de4-ad21-4a2d-a122-e0f24888b25b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:39.536664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e7a16de4-ad21-4a2d-a122-e0f24888b25b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:39.544446 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7a16de4-ad21-4a2d-a122-e0f24888b25b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.545589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7a16de4-ad21-4a2d-a122-e0f24888b25b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.546035 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7a16de4-ad21-4a2d-a122-e0f24888b25b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.546990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7a16de4-ad21-4a2d-a122-e0f24888b25b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.547455 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7a16de4-ad21-4a2d-a122-e0f24888b25b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.548044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7a16de4-ad21-4a2d-a122-e0f24888b25b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.573568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e7a16de4-ad21-4a2d-a122-e0f24888b25b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1/ips" status: 200 len: 151 microversion: 2.1 time: 0.040438 Aug 05 20:08:39.573568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 262/537] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:08:39 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:39.584815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b592256c-23e5-4112-8a38-2ce8171f34ce"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:39.587557 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:39.593646 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.594142 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.594580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.595283 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.595858 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.596303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.678473 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Invalid volume: volume b592256c-23e5-4112-8a38-2ce8171f34ce is already attached to instances: 96010245-806a-4bf6-90fb-2a70ac2a17ec Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: POST /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1/os-volume_attachments HTTP/1.1 Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 74 Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:08:39.680306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {"volumeAttachment": {"volumeId": "b592256c-23e5-4112-8a38-2ce8171f34ce"}} Aug 05 20:08:39.682411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Invalid volume: volume b592256c-23e5-4112-8a38-2ce8171f34ce is already attached to instances: 96010245-806a-4bf6-90fb-2a70ac2a17ec Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'server_id': 'd7081e39-a5af-4ee0-89d2-90d44d2b7dd1', 'body': {'volumeAttachment': {'volumeId': 'b592256c-23e5-4112-8a38-2ce8171f34ce'}}} Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b592256c-23e5-4112-8a38-2ce8171f34ce is already attached to instances: 96010245-806a-4bf6-90fb-2a70ac2a17ec Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:39.683149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b592256c-23e5-4112-8a38-2ce8171f34ce is already attached to instances: 96010245-806a-4bf6-90fb-2a70ac2a17ec Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:39.684440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:39.685580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:39.685580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:08:39.685580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:08:39.685580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b592256c-23e5-4112-8a38-2ce8171f34ce is already attached to instances: 96010245-806a-4bf6-90fb-2a70ac2a17ec Aug 05 20:08:39.685580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:39.685580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 400 to user: Invalid volume: volume b592256c-23e5-4112-8a38-2ce8171f34ce is already attached to instances: 96010245-806a-4bf6-90fb-2a70ac2a17ec {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:08:39.685580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-2a84cbc0-f5ef-4862-b047-b00d759d1192 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101895 Aug 05 20:08:39.685580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 263/538] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:08:39 2022] POST /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:08:39.692100 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:39.692561 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:39.699978 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.700476 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.700921 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.701627 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.702228 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.702660 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.729493 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:08:39.730493 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:39.739283 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6aa91ee3-d666-4f71-876b-5cb6ab9b12ba tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1513 microversion: 2.1 time: 0.236847 Aug 05 20:08:39.739885 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 276/539] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:39 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:39.819647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-53655209-b15f-48b2-aedc-38bd7d4222ad tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 204 len: 0 microversion: 2.1 time: 0.131050 Aug 05 20:08:39.820810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 264/540] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:08:39 2022] DELETE /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:08:39.833952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:39.848456 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:39.860478 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.861192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.861739 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.862590 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.863214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.863718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.892844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-1b06fd28-e85a-4051-ad1e-b059e6bdc3b0 req-6d55b51f-7fa3-41b4-b6a9-623e3860d47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0de831f-1cb5-4286-9c10-0fb614962af7", "name": "network-vif-deleted", "tag": "5a74e867-0a99-4c52-83b6-7c2e357cf53f"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:39.903060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-1b06fd28-e85a-4051-ad1e-b059e6bdc3b0 req-6d55b51f-7fa3-41b4-b6a9-623e3860d47f service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.903546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-1b06fd28-e85a-4051-ad1e-b059e6bdc3b0 req-6d55b51f-7fa3-41b4-b6a9-623e3860d47f service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.904009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-1b06fd28-e85a-4051-ad1e-b059e6bdc3b0 req-6d55b51f-7fa3-41b4-b6a9-623e3860d47f service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.916879 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-1b06fd28-e85a-4051-ad1e-b059e6bdc3b0 req-6d55b51f-7fa3-41b4-b6a9-623e3860d47f service nova] Creating event network-vif-deleted:5a74e867-0a99-4c52-83b6-7c2e357cf53f for instance b0de831f-1cb5-4286-9c10-0fb614962af7 on hv-cinder-85221 Aug 05 20:08:39.922116 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-1b06fd28-e85a-4051-ad1e-b059e6bdc3b0 req-6d55b51f-7fa3-41b4-b6a9-623e3860d47f service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 Aug 05 20:08:39.922721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 265/541] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:08:39.999017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:40.006516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-108986bb-969f-40c7-ae99-e55665c16ac0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1681 microversion: 2.1 time: 0.181258 Aug 05 20:08:40.007078 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 277/542] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:39 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:40.761598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:40.762209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:40.768759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:40.769248 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:40.769685 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:40.770369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:40.770821 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:40.771244 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:40.835634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:40.843976 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-905f345c-97f4-408e-833a-2aa23172badd tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1471 microversion: 2.1 time: 0.086854 Aug 05 20:08:40.844541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 266/543] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:40 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:41.028102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:41.028630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:41.035481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:41.036020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:41.036456 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:41.037145 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:41.037596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:41.038046 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:41.169919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:41.177330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3ce523a9-a0b4-4d04-8fd3-84691bfd7445 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1681 microversion: 2.1 time: 0.153274 Aug 05 20:08:41.177900 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 278/544] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:41 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:41.864508 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:41.865042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:41.871960 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:41.872452 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:41.872898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:41.873592 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:41.874053 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:41.874481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:41.937324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:41.944824 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3fcfbe3e-3b00-4799-9713-4e90660ccf95 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 200 len: 1304 microversion: 2.1 time: 0.084293 Aug 05 20:08:41.945377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 267/545] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:41 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:42.199201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:42.199821 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:42.206322 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:42.206837 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:42.207270 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:42.207985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:42.208434 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:42.208853 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:42.370379 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:42.378777 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fc560330-7a80-49cb-96b9-4ac82ae3a017 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1681 microversion: 2.1 time: 0.184188 Aug 05 20:08:42.379352 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 279/546] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:42 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:42.967172 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:42.968374 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: b0de831f-1cb5-4286-9c10-0fb614962af7] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:42.975189 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:42.976019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:42.976462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:42.978472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:42.978472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:42.978864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:42.993760 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] HTTP exception thrown: Instance b0de831f-1cb5-4286-9c10-0fb614962af7 could not be found. Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Request method failure captured: Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 HTTP/1.1 Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7Xhv_P4qH7Uro5HEBDgHmnffYs1yU44wnLC_mLvuGrbUobrCTDNtioDQBcSIyz6SqorTedMKpuC7Ieidk1ZJX1kbC1NM1ZiThZnTsUv0EQTHy2u6EZlSzQVdx3JwBNlLt2fF3CFPXT2Z8QmUB2VXWsd17uh7pPxEcvV8a0atWtFWRqk Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 62c8d8166fe14ab5a1651d0d48dff37a Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-VolumesSnapshotTestJSON-17205259 Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:08:42.995397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/62c8d8166fe14ab5a1651d0d48dff37a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_62c8d8166fe14ab5a1651d0d48dff37a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/62c8d8166fe14ab5a1651d0d48dff37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/62c8d8166fe14ab5a1651d0d48dff37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-VolumesSnapshotTestJSON-17205259 Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 62c8d8166fe14ab5a1651d0d48dff37a Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-17205259 Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-VolumesSnapshotTestJSON-17205259-project Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 3b2fcb1887f749dcb488c63054290a45 Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-VolumesSnapshotTestJSON-17205259-project Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance b0de831f-1cb5-4286-9c10-0fb614962af7 could not be found. Aug 05 20:08:42.996731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'b0de831f-1cb5-4286-9c10-0fb614962af7'} Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0de831f-1cb5-4286-9c10-0fb614962af7 could not be found. Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:08:42.997465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0de831f-1cb5-4286-9c10-0fb614962af7 could not be found. Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0de831f-1cb5-4286-9c10-0fb614962af7 could not be found. Aug 05 20:08:42.998611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:08:42.999667 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Returning 404 to user: Instance b0de831f-1cb5-4286-9c10-0fb614962af7 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:08:42.999667 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d478ae90-019e-45df-b68c-02a990a08fc3 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7" status: 404 len: 111 microversion: 2.1 time: 0.035499 Aug 05 20:08:43.002874 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 268/547] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:42 2022] GET /compute/v2.1/servers/b0de831f-1cb5-4286-9c10-0fb614962af7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:08:43.250050 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-fd28a392-c0ea-421c-8925-b9613808dd01 req-f629a53a-8f32-4c7f-8b36-6296c8153c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7081e39-a5af-4ee0-89d2-90d44d2b7dd1", "name": "network-vif-deleted", "tag": "5f35a769-e454-4292-84b5-95f09e160754"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:43.260367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-fd28a392-c0ea-421c-8925-b9613808dd01 req-f629a53a-8f32-4c7f-8b36-6296c8153c39 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:43.261103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-fd28a392-c0ea-421c-8925-b9613808dd01 req-f629a53a-8f32-4c7f-8b36-6296c8153c39 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:43.261723 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-fd28a392-c0ea-421c-8925-b9613808dd01 req-f629a53a-8f32-4c7f-8b36-6296c8153c39 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:43.273343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-fd28a392-c0ea-421c-8925-b9613808dd01 req-f629a53a-8f32-4c7f-8b36-6296c8153c39 service nova] Creating event network-vif-deleted:5f35a769-e454-4292-84b5-95f09e160754 for instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 on hv-cinder-85221 Aug 05 20:08:43.278431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-fd28a392-c0ea-421c-8925-b9613808dd01 req-f629a53a-8f32-4c7f-8b36-6296c8153c39 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032090 Aug 05 20:08:43.279037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 280/548] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:43.401030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:43.402025 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:43.408584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:43.409158 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:43.409687 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:43.410460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:43.410983 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:43.411481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:43.446129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:43.446894 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:43.454317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:43.455120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'fault' on Instance uuid d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:43.504424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:43.513372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b0b7a442-84ac-4ffc-aae5-82bc534ce5da tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1331 microversion: 2.1 time: 0.116686 Aug 05 20:08:43.514321 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 269/549] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:43 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:44.535831 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:44.536449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:44.543874 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:44.544360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:44.544813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:44.545483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:44.545936 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:44.546360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:44.580545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:44.581028 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:44.581459 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:44.581907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'fault' on Instance uuid d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:44.624788 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:44.632475 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-27eecfb7-ab10-4d81-a77e-fc666bdc83ab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1331 microversion: 2.1 time: 0.101620 Aug 05 20:08:44.633040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 281/550] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:44 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:45.653886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:45.654427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:45.660875 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:45.661354 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:45.661790 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:45.662485 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:45.662940 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:45.663365 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:45.694442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:45.694923 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:45.695355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:45.695831 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'fault' on Instance uuid d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:45.736286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:45.743605 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4711900f-9cf8-4196-a31e-7aaf17e47a67 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 200 len: 1331 microversion: 2.1 time: 0.093682 Aug 05 20:08:45.744194 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 270/551] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:45 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:46.764106 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:46.764711 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:46.771469 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:46.771979 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:46.772414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:46.773095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:46.773798 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:46.773997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:46.787114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 HTTP/1.1 Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:08:46.788766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:08:46.790254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'd7081e39-a5af-4ee0-89d2-90d44d2b7dd1'} Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:08:46.791108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:08:46.793340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:08:46.794661 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:08:46.794661 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-17083d94-a311-4afc-a245-1fe8069e7840 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 404 len: 111 microversion: 2.1 time: 0.030771 Aug 05 20:08:46.794661 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 282/552] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:46 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:08:46.800057 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4f2f72be-d7e2-4cf1-aa28-8f3f44de3a0b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '.version_select at 0x7f5691f21940>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:46.819854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4f2f72be-d7e2-4cf1-aa28-8f3f44de3a0b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-879832536" status: 202 len: 0 microversion: 2.1 time: 0.023521 Aug 05 20:08:46.820414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 271/553] 10.222.0.95 () {58 vars in 1218 bytes} [Fri Aug 5 20:08:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-879832536 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:08:47.507514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:47.508046 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:47.516947 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:47.517447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:47.517886 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:47.518689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:47.519155 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:47.519695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:47.644580 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'services' on Instance uuid 96010245-806a-4bf6-90fb-2a70ac2a17ec {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:47.757594 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0322a053-49a7-40fa-8432-499469b7e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments/b592256c-23e5-4112-8a38-2ce8171f34ce" status: 202 len: 0 microversion: 2.1 time: 0.253861 Aug 05 20:08:47.758179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 283/554] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:08:47 2022] DELETE /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments/b592256c-23e5-4112-8a38-2ce8171f34ce => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:08:47.766728 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f1703b0d-96b2-477c-8795-e234fe8b420e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:47.768851 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f1703b0d-96b2-477c-8795-e234fe8b420e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:47.775280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1703b0d-96b2-477c-8795-e234fe8b420e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:47.776097 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1703b0d-96b2-477c-8795-e234fe8b420e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:47.776857 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1703b0d-96b2-477c-8795-e234fe8b420e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:47.777650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1703b0d-96b2-477c-8795-e234fe8b420e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:47.778191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1703b0d-96b2-477c-8795-e234fe8b420e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:47.778708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1703b0d-96b2-477c-8795-e234fe8b420e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:47.810572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f1703b0d-96b2-477c-8795-e234fe8b420e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047765 Aug 05 20:08:47.811266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 272/555] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:08:47 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:48.823771 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d8ff729f-04e7-4b75-8297-fa58a24c8711 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:48.826236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d8ff729f-04e7-4b75-8297-fa58a24c8711 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:48.833194 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d8ff729f-04e7-4b75-8297-fa58a24c8711 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:48.833685 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d8ff729f-04e7-4b75-8297-fa58a24c8711 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:48.834124 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d8ff729f-04e7-4b75-8297-fa58a24c8711 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:48.834827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d8ff729f-04e7-4b75-8297-fa58a24c8711 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:48.835271 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d8ff729f-04e7-4b75-8297-fa58a24c8711 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:48.835691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d8ff729f-04e7-4b75-8297-fa58a24c8711 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:48.865059 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d8ff729f-04e7-4b75-8297-fa58a24c8711 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Aug 05 20:08:48.865619 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 284/556] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:08:48 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:49.878435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-90427b44-dd74-439e-98aa-d683ab2b4fd5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:49.880598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-90427b44-dd74-439e-98aa-d683ab2b4fd5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:49.888010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90427b44-dd74-439e-98aa-d683ab2b4fd5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:49.888495 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90427b44-dd74-439e-98aa-d683ab2b4fd5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:49.888934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90427b44-dd74-439e-98aa-d683ab2b4fd5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:49.889631 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90427b44-dd74-439e-98aa-d683ab2b4fd5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:49.890239 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90427b44-dd74-439e-98aa-d683ab2b4fd5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:49.890665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90427b44-dd74-439e-98aa-d683ab2b4fd5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:49.920664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-90427b44-dd74-439e-98aa-d683ab2b4fd5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Aug 05 20:08:49.921219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 273/557] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:08:49 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:50.933358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4f6ab2ee-7e23-4642-953a-8bae792d0f6e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:50.935470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4f6ab2ee-7e23-4642-953a-8bae792d0f6e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:50.942322 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f6ab2ee-7e23-4642-953a-8bae792d0f6e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:50.942992 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f6ab2ee-7e23-4642-953a-8bae792d0f6e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:50.943477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f6ab2ee-7e23-4642-953a-8bae792d0f6e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:50.944207 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f6ab2ee-7e23-4642-953a-8bae792d0f6e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:50.944671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f6ab2ee-7e23-4642-953a-8bae792d0f6e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:50.945078 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f6ab2ee-7e23-4642-953a-8bae792d0f6e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:50.973965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4f6ab2ee-7e23-4642-953a-8bae792d0f6e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045035 Aug 05 20:08:50.974508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 285/558] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:08:50 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:51.985486 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0489bb7e-716a-4a40-a94c-e9f40174674a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:51.987750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0489bb7e-716a-4a40-a94c-e9f40174674a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:51.994897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0489bb7e-716a-4a40-a94c-e9f40174674a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:51.995388 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0489bb7e-716a-4a40-a94c-e9f40174674a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:51.996056 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0489bb7e-716a-4a40-a94c-e9f40174674a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:51.996772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0489bb7e-716a-4a40-a94c-e9f40174674a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:51.997229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0489bb7e-716a-4a40-a94c-e9f40174674a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:51.997688 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0489bb7e-716a-4a40-a94c-e9f40174674a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:52.029149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0489bb7e-716a-4a40-a94c-e9f40174674a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047538 Aug 05 20:08:52.029707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 274/559] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:08:51 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:52.949454 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1274551934", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "networks": [{"uuid": "a6618a56-807a-484d-bf9c-8b5af4857258"}]}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:53.005049 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] validate_networks() for [('a6618a56-807a-484d-bf9c-8b5af4857258', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:08:53.041428 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-09260596-68bd-4510-b4dd-7553a5928f80 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:53.043875 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-09260596-68bd-4510-b4dd-7553a5928f80 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:53.050243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09260596-68bd-4510-b4dd-7553a5928f80 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.050795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09260596-68bd-4510-b4dd-7553a5928f80 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.051249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09260596-68bd-4510-b4dd-7553a5928f80 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.051968 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09260596-68bd-4510-b4dd-7553a5928f80 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.052426 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09260596-68bd-4510-b4dd-7553a5928f80 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.052862 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-09260596-68bd-4510-b4dd-7553a5928f80 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.056759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:53.085907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-09260596-68bd-4510-b4dd-7553a5928f80 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048286 Aug 05 20:08:53.086385 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 275/560] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:08:53 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 20:08:53.148870 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:53.149365 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:53.155985 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.156530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.156966 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.157878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.158337 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.158808 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.185030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:08:53.265667 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-961da035-cf58-4023-baaf-2febda4ba9ed tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 204 len: 0 microversion: 2.1 time: 0.120187 Aug 05 20:08:53.266664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 276/561] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:08:53 2022] DELETE /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:08:53.275635 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:53.276579 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:53.283501 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.284039 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.284484 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.285182 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.285640 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.286071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.374476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:08:53.374903 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:08:53.375449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:08:53.375931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:08:53.376382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:08:53.386011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.386490 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.386924 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.387652 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.388136 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.388558 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.405293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Getting quotas for project 62c8d8166fe14ab5a1651d0d48dff37a. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:08:53.410212 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Getting quotas for user 3b2fcb1887f749dcb488c63054290a45 and project 62c8d8166fe14ab5a1651d0d48dff37a. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:08:53.420294 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:53.423565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:08:53.426595 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:08:53.429081 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-07abb71f-3008-4f6c-955d-0008543cd138 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1683 microversion: 2.1 time: 0.157930 Aug 05 20:08:53.429658 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 277/562] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:53 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:53.472638 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-37c67583-44db-4640-b4f4-6a0570b69e00 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527642 Aug 05 20:08:53.473282 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 286/563] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:08:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:08:53.484239 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ae574e08-1970-4c67-8edb-e28f43d0b0c4 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:53.484849 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ae574e08-1970-4c67-8edb-e28f43d0b0c4 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:53.554151 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ae574e08-1970-4c67-8edb-e28f43d0b0c4 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:53.562161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ae574e08-1970-4c67-8edb-e28f43d0b0c4 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1219 microversion: 2.1 time: 0.081673 Aug 05 20:08:53.562832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 278/564] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:53 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:54.162195 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-397c0042-6ae3-401c-86d3-7a2676d0e782 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:54.162711 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-397c0042-6ae3-401c-86d3-7a2676d0e782 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:54.169993 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-397c0042-6ae3-401c-86d3-7a2676d0e782 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.170479 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-397c0042-6ae3-401c-86d3-7a2676d0e782 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.170940 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-397c0042-6ae3-401c-86d3-7a2676d0e782 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.171635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-397c0042-6ae3-401c-86d3-7a2676d0e782 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.172117 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-397c0042-6ae3-401c-86d3-7a2676d0e782 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.172550 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-397c0042-6ae3-401c-86d3-7a2676d0e782 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.202376 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-397c0042-6ae3-401c-86d3-7a2676d0e782 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments/2f344e2d-d033-4e20-84f5-417f78869236" status: 200 len: 194 microversion: 2.20 time: 0.044805 Aug 05 20:08:54.202951 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 287/565] 10.222.0.95 () {60 vars in 1454 bytes} [Fri Aug 5 20:08:54 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments/2f344e2d-d033-4e20-84f5-417f78869236 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 20:08:54.269778 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:54.270263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:54.276840 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.277319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.277752 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.278436 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.278887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.279311 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.362284 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lazy-loading 'services' on Instance uuid a49e6225-f22b-44fc-ad77-be5500dd95ca {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:54.434700 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-233ddcb3-4f85-4a69-ac10-e99cad8f31e2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "DELETE /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments/2f344e2d-d033-4e20-84f5-417f78869236" status: 202 len: 0 microversion: 2.20 time: 0.168700 Aug 05 20:08:54.435297 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 279/566] 10.222.0.95 () {60 vars in 1457 bytes} [Fri Aug 5 20:08:54 2022] DELETE /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments/2f344e2d-d033-4e20-84f5-417f78869236 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:08:54.443881 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0b177a6b-3877-4b19-afe9-4f868ad0bfda tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:54.446157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0b177a6b-3877-4b19-afe9-4f868ad0bfda tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:54.450585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:54.451294 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:54.452466 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b177a6b-3877-4b19-afe9-4f868ad0bfda tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.452967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b177a6b-3877-4b19-afe9-4f868ad0bfda tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.453385 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b177a6b-3877-4b19-afe9-4f868ad0bfda tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.454082 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b177a6b-3877-4b19-afe9-4f868ad0bfda tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.454531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b177a6b-3877-4b19-afe9-4f868ad0bfda tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.454949 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b177a6b-3877-4b19-afe9-4f868ad0bfda tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.457481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.457967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.458415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.459108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.459566 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.460025 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.487622 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0b177a6b-3877-4b19-afe9-4f868ad0bfda tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047749 Aug 05 20:08:54.488246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 288/567] 10.222.0.95 () {60 vars in 1343 bytes} [Fri Aug 5 20:08:54 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:08:54.583706 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:54.584394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:54.590484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.590968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.591405 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.592117 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.592570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.592990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.594674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:54.602068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9936b03c-d647-49b8-b7a8-16055b550d07 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1683 microversion: 2.1 time: 0.155602 Aug 05 20:08:54.602725 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 280/568] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:54 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:54.656565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:54.660031 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:54.664566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3af437d5-be2c-47df-93b9-5fd1e0361236 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1223 microversion: 2.1 time: 0.084800 Aug 05 20:08:54.665128 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 289/569] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:54 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:55.500491 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a419d0b2-939d-4477-a8fc-1b34ca0179df tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:55.502866 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a419d0b2-939d-4477-a8fc-1b34ca0179df tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:55.509201 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a419d0b2-939d-4477-a8fc-1b34ca0179df tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:55.509694 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a419d0b2-939d-4477-a8fc-1b34ca0179df tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:55.510883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a419d0b2-939d-4477-a8fc-1b34ca0179df tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:55.511592 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a419d0b2-939d-4477-a8fc-1b34ca0179df tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:55.512082 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a419d0b2-939d-4477-a8fc-1b34ca0179df tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:55.512515 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a419d0b2-939d-4477-a8fc-1b34ca0179df tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:55.542949 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a419d0b2-939d-4477-a8fc-1b34ca0179df tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046126 Aug 05 20:08:55.543664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 281/570] 10.222.0.95 () {60 vars in 1343 bytes} [Fri Aug 5 20:08:55 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 20:08:55.625102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:55.625710 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:55.632858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:55.633341 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:55.633788 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:55.634507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:55.635579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:55.636082 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:55.687302 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:55.687870 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:55.696052 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:55.696843 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:55.696975 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:55.698366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:55.698888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:55.699351 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:55.764232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:55.771707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-408febf8-875f-42ed-9212-22391e191e3c tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1215 microversion: 2.1 time: 0.088927 Aug 05 20:08:55.772319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 282/571] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:55 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:55.784440 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:55.793114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9d12eae9-430b-48ba-82a8-091ac7205d63 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1683 microversion: 2.1 time: 0.172233 Aug 05 20:08:55.793679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 290/572] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:55 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:56.554743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f1612352-a9bf-4d0d-8c4e-011fb99c492d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:56.557560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f1612352-a9bf-4d0d-8c4e-011fb99c492d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:56.563930 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1612352-a9bf-4d0d-8c4e-011fb99c492d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:56.564410 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1612352-a9bf-4d0d-8c4e-011fb99c492d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:56.564841 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1612352-a9bf-4d0d-8c4e-011fb99c492d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:56.565518 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1612352-a9bf-4d0d-8c4e-011fb99c492d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:56.565969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1612352-a9bf-4d0d-8c4e-011fb99c492d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:56.566387 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f1612352-a9bf-4d0d-8c4e-011fb99c492d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:56.594670 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f1612352-a9bf-4d0d-8c4e-011fb99c492d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043931 Aug 05 20:08:56.595278 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 283/573] 10.222.0.95 () {60 vars in 1343 bytes} [Fri Aug 5 20:08:56 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:08:56.796144 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:56.796760 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:56.803221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:56.803707 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:56.804177 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:56.804866 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:56.805322 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:56.805750 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:56.814266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:56.814866 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:56.820658 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:56.821140 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:56.821572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:56.822300 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:56.822871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:56.823723 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:56.870159 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:56.877733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-358b17c3-63e3-4d8c-9068-b416d6f9db23 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1271 microversion: 2.1 time: 0.086639 Aug 05 20:08:56.878302 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 291/574] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:56 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:56.959868 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:56.968063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7e1eb108-f57e-46df-8f5c-7e2c5602b9ca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1683 microversion: 2.1 time: 0.157763 Aug 05 20:08:56.968628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 284/575] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:56 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:57.606657 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0e4a684f-0108-41a5-a664-7560cde581f0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:57.609700 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0e4a684f-0108-41a5-a664-7560cde581f0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:57.615860 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e4a684f-0108-41a5-a664-7560cde581f0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:57.616380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e4a684f-0108-41a5-a664-7560cde581f0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:57.616824 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e4a684f-0108-41a5-a664-7560cde581f0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:57.617527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e4a684f-0108-41a5-a664-7560cde581f0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:57.617986 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e4a684f-0108-41a5-a664-7560cde581f0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:57.618418 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0e4a684f-0108-41a5-a664-7560cde581f0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:57.659859 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0e4a684f-0108-41a5-a664-7560cde581f0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057086 Aug 05 20:08:57.664389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 292/576] 10.222.0.95 () {60 vars in 1343 bytes} [Fri Aug 5 20:08:57 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:08:57.898676 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:57.899254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:57.906652 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:57.907146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:57.907754 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:57.908490 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:57.909062 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:57.909495 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:57.973657 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:57.981143 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1af5fffc-cfd0-4057-945a-35ea8a1e1134 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1277 microversion: 2.1 time: 0.086353 Aug 05 20:08:57.981719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 285/577] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:57 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:57.990653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:57.991862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:57.998417 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:57.998900 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:57.999328 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.000043 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.000522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.001099 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.112389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:58.120796 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-25af7f94-542e-4cf6-93ff-ff4d7726a966 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1615 microversion: 2.1 time: 0.134810 Aug 05 20:08:58.121461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 293/578] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:57 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1615 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:58.246623 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-5d70ba3c-a337-4156-b391-deb6bcd4e4e7 req-fd7b97d7-b8f2-4866-b8f6-139fca88765c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96010245-806a-4bf6-90fb-2a70ac2a17ec", "name": "network-vif-deleted", "tag": "c56b1bbe-d959-41b4-ba80-de2afa26f697"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:58.262983 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-5d70ba3c-a337-4156-b391-deb6bcd4e4e7 req-fd7b97d7-b8f2-4866-b8f6-139fca88765c service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.263967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-5d70ba3c-a337-4156-b391-deb6bcd4e4e7 req-fd7b97d7-b8f2-4866-b8f6-139fca88765c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.264625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-5d70ba3c-a337-4156-b391-deb6bcd4e4e7 req-fd7b97d7-b8f2-4866-b8f6-139fca88765c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.277448 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-5d70ba3c-a337-4156-b391-deb6bcd4e4e7 req-fd7b97d7-b8f2-4866-b8f6-139fca88765c service nova] Creating event network-vif-deleted:c56b1bbe-d959-41b4-ba80-de2afa26f697 for instance 96010245-806a-4bf6-90fb-2a70ac2a17ec on hv-cinder-85221 Aug 05 20:08:58.283808 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-5d70ba3c-a337-4156-b391-deb6bcd4e4e7 req-fd7b97d7-b8f2-4866-b8f6-139fca88765c service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040598 Aug 05 20:08:58.284738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 286/579] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:58.673458 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9b5c2f6f-e057-4d9f-9653-9016229a6109 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:58.675772 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9b5c2f6f-e057-4d9f-9653-9016229a6109 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:58.682505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b5c2f6f-e057-4d9f-9653-9016229a6109 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.683003 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b5c2f6f-e057-4d9f-9653-9016229a6109 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.683447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b5c2f6f-e057-4d9f-9653-9016229a6109 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.684186 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b5c2f6f-e057-4d9f-9653-9016229a6109 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.684639 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b5c2f6f-e057-4d9f-9653-9016229a6109 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.685065 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b5c2f6f-e057-4d9f-9653-9016229a6109 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.718369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9b5c2f6f-e057-4d9f-9653-9016229a6109 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048820 Aug 05 20:08:58.719411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 294/580] 10.222.0.95 () {60 vars in 1343 bytes} [Fri Aug 5 20:08:58 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:58.799528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:58.800160 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:58.809145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.809898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.811153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.812453 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.813116 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.813723 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.840103 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:08:58.945331 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5950889a-c0db-4587-bcdb-7782777046b8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "DELETE /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 204 len: 0 microversion: 2.20 time: 0.157809 Aug 05 20:08:58.947796 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 287/581] 10.222.0.95 () {60 vars in 1280 bytes} [Fri Aug 5 20:08:58 2022] DELETE /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:08:58.955107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:58.956009 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:58.962296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.963027 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.963646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.964563 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.965174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.965762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:59.004115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:59.004998 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:59.011317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:59.011838 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:59.012317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:59.014151 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:59.015424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:59.016568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:59.161509 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:59.170012 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e0b20afc-0002-4849-8780-2f756cd0cc4f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1319 microversion: 2.1 time: 0.170413 Aug 05 20:08:59.171248 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 288/582] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:58 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:59.176541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:59.177470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:59.189827 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:59.190558 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:59.191201 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:59.192031 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:59.192555 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:59.193184 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:59.213155 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:59.217580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:59.222790 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:59.224440 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:59.225607 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a594b90a-4c1a-4989-96c4-e29b9f6b5c09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.274868 Aug 05 20:08:59.226156 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 295/583] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:08:58 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:08:59.235990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:59.236607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:59.237145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:59.237693 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'fault' on Instance uuid 96010245-806a-4bf6-90fb-2a70ac2a17ec {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:59.282959 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:59.291303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a0531ba6-2048-4d3b-91be-a4274cc1ee8a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1332 microversion: 2.1 time: 0.118706 Aug 05 20:08:59.292255 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 289/584] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:59 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:00.191690 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:00.192315 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:00.198728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:00.199206 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:00.199645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:00.200361 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:00.200814 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:00.201869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:00.250470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:00.251051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:00.257610 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:00.258093 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:00.258528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:00.259208 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:00.259654 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:00.260099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:00.347151 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:00.355349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4ce1dbf4-e3fc-4236-af2d-87d87bbd5bf2 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1319 microversion: 2.1 time: 0.167546 Aug 05 20:09:00.355969 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 296/585] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:00 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:00.360882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-07af68ea-d0c2-43ad-bde5-d28e7e8fe775 req-165bc111-5b2f-4005-a7eb-30b3229426d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d920859b-d29e-4bac-8e7b-000a2684631f", "tag": "022ca850-433b-4d4b-a726-81ce11fcfd91"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:00.369515 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-07af68ea-d0c2-43ad-bde5-d28e7e8fe775 req-165bc111-5b2f-4005-a7eb-30b3229426d3 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:00.369979 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-07af68ea-d0c2-43ad-bde5-d28e7e8fe775 req-165bc111-5b2f-4005-a7eb-30b3229426d3 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:00.370400 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-07af68ea-d0c2-43ad-bde5-d28e7e8fe775 req-165bc111-5b2f-4005-a7eb-30b3229426d3 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:00.381632 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-07af68ea-d0c2-43ad-bde5-d28e7e8fe775 req-165bc111-5b2f-4005-a7eb-30b3229426d3 service nova] Creating event network-changed:022ca850-433b-4d4b-a726-81ce11fcfd91 for instance d920859b-d29e-4bac-8e7b-000a2684631f on hv-cinder-85221 Aug 05 20:09:00.386890 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-07af68ea-d0c2-43ad-bde5-d28e7e8fe775 req-165bc111-5b2f-4005-a7eb-30b3229426d3 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029785 Aug 05 20:09:00.387488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 297/586] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:00.393170 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:00.393865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:00.394195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:00.400032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:00.400513 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:00.400945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:00.401630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:00.402079 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:00.402182 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:00.402498 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:00.403683 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:00.405920 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4baa75ee-e91f-44fb-ad2b-61800f353d0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.158877 Aug 05 20:09:00.406069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 290/587] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:00 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:09:00.435988 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:00.436483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:00.436927 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:00.437381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'fault' on Instance uuid 96010245-806a-4bf6-90fb-2a70ac2a17ec {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:09:00.480767 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:00.489337 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6d2a8625-6398-4ae1-8e7b-3f3567393e6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 200 len: 1332 microversion: 2.1 time: 0.100713 Aug 05 20:09:00.489919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 298/588] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:00 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:01.376620 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:01.377216 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:01.383698 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:01.384210 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:01.384640 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:01.385321 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:01.385770 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:01.386192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:01.432320 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:01.433496 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:01.441233 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:01.441878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:01.442555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:01.443350 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:01.443945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:01.444538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:01.529511 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:01.538028 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-cab4a5a5-4ca3-43d7-a1d6-b0b686b29f58 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1319 microversion: 2.1 time: 0.165249 Aug 05 20:09:01.538623 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 291/589] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:01 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:01.557979 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:01.558603 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:01.565409 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:01.565906 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:01.566352 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:01.567055 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:01.567522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:01.567980 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:01.581802 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec HTTP/1.1 Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:09:01.583425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:09:01.585063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '96010245-806a-4bf6-90fb-2a70ac2a17ec'} Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:09:01.585962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:09:01.587472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:01.589319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:09:01.589319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3751858a-bd7b-4fd9-a772-d789e0e0c4cd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 404 len: 111 microversion: 2.1 time: 0.035797 Aug 05 20:09:01.589319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 292/590] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:01 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:09:01.596783 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3b5729da-a0e7-4679-9316-e1c0fc1c332f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '.version_select at 0x7f5691d71820>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:01.609944 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:01.617850 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3b5729da-a0e7-4679-9316-e1c0fc1c332f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024977831" status: 202 len: 0 microversion: 2.1 time: 0.025542 Aug 05 20:09:01.618619 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 293/591] 10.222.0.95 () {58 vars in 1221 bytes} [Fri Aug 5 20:09:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024977831 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:09:01.786292 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:01.797129 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:01.800163 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:01.801658 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a69abdc3-6a3b-45d2-9077-d5b2b2761ee1 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1723 microversion: 2.20 time: 0.373403 Aug 05 20:09:01.802570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 299/592] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:01 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:02.281283 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6ad031b6-8a66-4f84-bd51-3cf737e7e0b0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: .version_select at 0x7f5691cf2820>, body: {"keypair": {"name": "tempest-keypair-969856629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdhLcK1eMYFyjALa7v+CQs8jkezaU2maDHe6fXdJBGYuPezeTXMVsiOP9exwDle58Q84Xn6bcs9PUuAxKJcyDqa46tU3jNvBaHdAbLIxbznonxe8MkLLmO704L/5uGsFg=="}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:02.301364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-6ad031b6-8a66-4f84-bd51-3cf737e7e0b0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for project 43323ff64b8843639e0428c69d5c71c1. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:09:02.305316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-6ad031b6-8a66-4f84-bd51-3cf737e7e0b0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for user 67e79817ed9e40728f92a22053a24118 and project 43323ff64b8843639e0428c69d5c71c1. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:09:02.330470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6ad031b6-8a66-4f84-bd51-3cf737e7e0b0 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053580 Aug 05 20:09:02.331113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 294/593] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:09:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:02.565125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:02.565851 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:02.573150 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.573642 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.574114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:02.575120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.575836 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.576307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:02.825870 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:02.826589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:02.834489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.835145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.835832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:02.836825 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.837406 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.837933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:02.879471 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:02.892217 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e1496418-15bb-493a-9dc9-8ff0034affaa tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1319 microversion: 2.1 time: 0.331336 Aug 05 20:09:02.904579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 300/594] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:02 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:02.927481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:02.951106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:02.953313 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:02.954502 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1f11759e-8f7f-40a2-a6c0-c320b7319167 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1655 microversion: 2.20 time: 0.132899 Aug 05 20:09:02.976544 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 295/595] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:02 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:03.010185 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-5e30c74c-6b93-4ac6-b841-bede02ae240c req-cc9816c1-d522-4215-a091-23107cae32e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49e6225-f22b-44fc-ad77-be5500dd95ca", "name": "network-vif-deleted", "tag": "1bdc744a-8e2b-4857-9c57-b9ac61ab593c"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:03.021028 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-5e30c74c-6b93-4ac6-b841-bede02ae240c req-cc9816c1-d522-4215-a091-23107cae32e2 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:03.021439 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-5e30c74c-6b93-4ac6-b841-bede02ae240c req-cc9816c1-d522-4215-a091-23107cae32e2 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:03.021863 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-5e30c74c-6b93-4ac6-b841-bede02ae240c req-cc9816c1-d522-4215-a091-23107cae32e2 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:03.034257 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-5e30c74c-6b93-4ac6-b841-bede02ae240c req-cc9816c1-d522-4215-a091-23107cae32e2 service nova] Creating event network-vif-deleted:1bdc744a-8e2b-4857-9c57-b9ac61ab593c for instance a49e6225-f22b-44fc-ad77-be5500dd95ca on hv-cinder-85221 Aug 05 20:09:03.039516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-5e30c74c-6b93-4ac6-b841-bede02ae240c req-cc9816c1-d522-4215-a091-23107cae32e2 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Aug 05 20:09:03.040458 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 301/596] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:03.916941 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:03.918250 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:03.928042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:03.928846 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:03.930935 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:03.932939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:03.934476 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:03.935131 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:03.982423 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:03.983120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:03.986168 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:03.986821 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=6 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:04.003593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:04.003876 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:04.006044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:04.006827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:04.008133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:04.008133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:04.148441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:04.149204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:04.161429 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-52c6358e-3e55-4527-9925-08d1e471584a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1319 microversion: 2.1 time: 0.250446 Aug 05 20:09:04.161933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:04.163645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:04.165279 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-190b2b57-c558-4f32-9996-d0f9e4787368 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 200 len: 1367 microversion: 2.20 time: 0.188112 Aug 05 20:09:04.175614 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 296/598] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:03 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:04.176041 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 302/598] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:03 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:04.284515 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-897731013", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e6eb1b0-c7d1-48fb-bae8-24a190109c29"}], "security_groups": [{"name": "tempest-securitygroup--1609868525"}], "key_name": "tempest-keypair-969856629", "user_data": "}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:04.421817 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.network.neutron [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] validate_networks() for [('0e6eb1b0-c7d1-48fb-bae8-24a190109c29', None, None, None, None, None)] {{(pid=118175) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:09:04.813994 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Flavor limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:09:04.815278 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Image limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:09:04.815989 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Flavor pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:09:04.816514 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Image pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:09:04.818090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:09:04.828178 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:04.828682 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:04.829115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:04.830117 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:04.830611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:04.831040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:04.850838 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for project 43323ff64b8843639e0428c69d5c71c1. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:09:04.855073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for user 67e79817ed9e40728f92a22053a24118 and project 43323ff64b8843639e0428c69d5c71c1. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:09:04.876801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Going to run 1 instances... {{(pid=118175) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:09:04.879069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118175) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:09:04.927952 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1941e56e-58af-4913-aa2f-72fde0d764c3 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.653010 Aug 05 20:09:04.930216 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 297/599] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:09:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:09:04.942979 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-127ab18b-23b7-4458-95ab-1e603f67d0a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:04.943509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-127ab18b-23b7-4458-95ab-1e603f67d0a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:05.064170 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-127ab18b-23b7-4458-95ab-1e603f67d0a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:05.071581 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-127ab18b-23b7-4458-95ab-1e603f67d0a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1240 microversion: 2.1 time: 0.132869 Aug 05 20:09:05.072974 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 303/600] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:04 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:05.182473 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:05.183076 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:05.191154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:05.191643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:05.192257 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:05.192957 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:05.193464 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:05.193835 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:05.195045 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:05.195945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:05.205221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:05.205787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:05.206554 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:05.207453 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:05.208493 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:05.209111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:05.229635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] HTTP exception thrown: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Request method failure captured: Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca HTTP/1.1 Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfBbaLKnEyeIqfaQFeAKM7uaQD5e4OM5pXxDnbyyu3q1UK6In83d-PUeoi7F4Or8Nd6giBymxTdbEqeMHuVuwtRH71y41Z03oVY0N9SUPKwfZ3BlqkxzjwQcrJZFcTJqzCUadF4vhs9asB2-8xsHxFDgfxrxYPHpWfedHwHNcqnOS8 Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:09:05.231437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: edf898f67aca42db8d51924ca4d8a300 Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:09:05.233094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'a49e6225-f22b-44fc-ad77-be5500dd95ca'} Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:09:05.234968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:09:05.237509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:09:05.240503 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Returning 404 to user: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:09:05.240503 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-15f6f0d3-bdd4-43e3-a637-0a3ad48f08bf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 404 len: 111 microversion: 2.20 time: 0.042283 Aug 05 20:09:05.240503 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 304/601] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:05 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:09:05.242223 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-88f629b7-1123-4982-9769-7b57dd1dcdb8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '.version_select at 0x7f5691e0d160>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:05.265698 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-88f629b7-1123-4982-9769-7b57dd1dcdb8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141211401" status: 204 len: 0 microversion: 2.20 time: 0.025671 Aug 05 20:09:05.269206 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 305/602] 10.222.0.95 () {60 vars in 1262 bytes} [Fri Aug 5 20:09:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141211401 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:09:05.357225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:05.365733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3363cc4a-2833-4723-a3ca-f3845305d322 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1319 microversion: 2.1 time: 0.187124 Aug 05 20:09:05.366308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 298/603] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:05 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:05.942075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6acae2c3-efbb-427b-99a7-ede47cbd23bc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'create', calling method: .version_select at 0x7f5691e288b0>, body: {"keypair": {"name": "tempest-keypair-658636166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzDYXGYAlQVa42XTgCKUiDZx/q0wuOvabMA6r8TdJpbhgtGYXJiwqBJyceZ6GLi9z7PqB28imwZn+jMwHqXQHJfRdN1rnQoDX92tbkzFsfjPlxF9KLI9hG/Ldr7D/h59A=="}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:05.948060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:05.961866 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-6acae2c3-efbb-427b-99a7-ede47cbd23bc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Getting quotas for project 0520f87324854dd0a5d0c9e10caa7fda. Resources: {'key_pairs'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:09:05.966633 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-6acae2c3-efbb-427b-99a7-ede47cbd23bc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Getting quotas for user edf898f67aca42db8d51924ca4d8a300 and project 0520f87324854dd0a5d0c9e10caa7fda. Resources: {'key_pairs'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:09:05.991332 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6acae2c3-efbb-427b-99a7-ede47cbd23bc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.053335 Aug 05 20:09:05.991958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 306/604] 10.222.0.95 () {62 vars in 1200 bytes} [Fri Aug 5 20:09:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 20:09:06.095217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:06.095886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:06.102101 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:06.102854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:06.103459 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:06.104374 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:06.105017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:06.105611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:06.201810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:06.215096 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3e051d11-b52f-461a-9563-fe477935cd31 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1292 microversion: 2.1 time: 0.125558 Aug 05 20:09:06.219859 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 299/605] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:06 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1292 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:06.231099 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-5b45fd6e-7d5f-43e1-8204-911302347d41 req-c975e84b-b794-44e7-a9e6-a70ce4a2266f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d920859b-d29e-4bac-8e7b-000a2684631f", "name": "network-vif-plugged", "status": "completed", "tag": "022ca850-433b-4d4b-a726-81ce11fcfd91"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:06.246119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-5b45fd6e-7d5f-43e1-8204-911302347d41 req-c975e84b-b794-44e7-a9e6-a70ce4a2266f service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:06.246881 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-5b45fd6e-7d5f-43e1-8204-911302347d41 req-c975e84b-b794-44e7-a9e6-a70ce4a2266f service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:06.247549 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-5b45fd6e-7d5f-43e1-8204-911302347d41 req-c975e84b-b794-44e7-a9e6-a70ce4a2266f service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:06.265830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-5b45fd6e-7d5f-43e1-8204-911302347d41 req-c975e84b-b794-44e7-a9e6-a70ce4a2266f service nova] Creating event network-vif-plugged:022ca850-433b-4d4b-a726-81ce11fcfd91 for instance d920859b-d29e-4bac-8e7b-000a2684631f on hv-cinder-85221 Aug 05 20:09:06.271483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-5b45fd6e-7d5f-43e1-8204-911302347d41 req-c975e84b-b794-44e7-a9e6-a70ce4a2266f service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044880 Aug 05 20:09:06.272470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 307/606] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:06.386659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:06.387266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:06.394321 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:06.394687 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:06.395372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:06.396344 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:06.396874 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:06.397385 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:06.625439 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:06.633987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c75a634a-42d3-413d-a16f-898019e79a48 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1319 microversion: 2.1 time: 0.251232 Aug 05 20:09:06.634757 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 300/607] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:06 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:07.238804 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:07.239553 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:07.246669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:07.248524 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:07.248524 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:07.248524 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:07.249102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:07.249531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:07.332552 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:07.340232 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d477f80b-ae2b-4fdb-9368-8baee178ce8c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1298 microversion: 2.1 time: 0.106799 Aug 05 20:09:07.341041 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 308/608] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:07 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:07.657547 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:07.662863 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2105595271", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5382f35a-6213-4f6e-b86e-02098406e5c9"}], "security_groups": [{"name": "tempest-securitygroup--1053510846"}], "key_name": "tempest-keypair-658636166", "user_data": "}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:07.664083 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:07.681322 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:07.681947 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:07.682486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:07.683315 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:07.684039 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:07.684616 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:07.829828 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:07.837222 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d564eee7-146c-4111-bdd2-d14c9bab0c7f tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1319 microversion: 2.1 time: 0.186188 Aug 05 20:09:07.838030 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 309/609] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:07 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:07.888906 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.network.neutron [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] validate_networks() for [('5382f35a-6213-4f6e-b86e-02098406e5c9', None, None, None, None, None)] {{(pid=118175) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:09:08.265977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Flavor limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:09:08.266478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Image limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:09:08.266952 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Flavor pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:09:08.267363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Image pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:09:08.267789 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:09:08.276434 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:08.276916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:08.277352 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:08.278075 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:08.278531 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:08.278960 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:08.299971 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Getting quotas for project 0520f87324854dd0a5d0c9e10caa7fda. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:09:08.303731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Getting quotas for user edf898f67aca42db8d51924ca4d8a300 and project 0520f87324854dd0a5d0c9e10caa7fda. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:09:08.314863 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Going to run 1 instances... {{(pid=118175) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:09:08.317030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118175) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:09:08.363266 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:08.363916 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:08.366483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f115c927-de01-4226-b38f-e14044e6bf95 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.718819 Aug 05 20:09:08.367669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 301/610] 10.222.0.95 () {62 vars in 1188 bytes} [Fri Aug 5 20:09:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 20:09:08.371370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:08.371886 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:08.372320 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:08.373010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:08.373615 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:08.374485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:08.378542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-67cb971b-b7fe-478d-9e0d-a506f3b8274a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:08.379282 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-67cb971b-b7fe-478d-9e0d-a506f3b8274a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:08.449287 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-67cb971b-b7fe-478d-9e0d-a506f3b8274a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:08.457693 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-67cb971b-b7fe-478d-9e0d-a506f3b8274a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:08.459467 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-67cb971b-b7fe-478d-9e0d-a506f3b8274a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:08.460981 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-67cb971b-b7fe-478d-9e0d-a506f3b8274a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1281 microversion: 2.20 time: 0.086653 Aug 05 20:09:08.462078 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 302/611] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:08 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:08.632467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:08.644767 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f3b602ab-521a-41cf-9cb5-6defdd92de6b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1366 microversion: 2.1 time: 0.287028 Aug 05 20:09:08.645874 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 310/612] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:08 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:08.754726 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-123ac407-36af-483c-9f09-d59dc01a8790 req-797ea731-356c-4e23-a8dc-268be760170c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad207769-9bf5-4536-aa34-9551111c85e1", "tag": "680925df-cba7-4d99-b3aa-9bbe2b6329d9"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:08.768264 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-123ac407-36af-483c-9f09-d59dc01a8790 req-797ea731-356c-4e23-a8dc-268be760170c service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:08.768789 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-123ac407-36af-483c-9f09-d59dc01a8790 req-797ea731-356c-4e23-a8dc-268be760170c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:08.769412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-123ac407-36af-483c-9f09-d59dc01a8790 req-797ea731-356c-4e23-a8dc-268be760170c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:08.782100 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-123ac407-36af-483c-9f09-d59dc01a8790 req-797ea731-356c-4e23-a8dc-268be760170c service nova] Creating event network-changed:680925df-cba7-4d99-b3aa-9bbe2b6329d9 for instance ad207769-9bf5-4536-aa34-9551111c85e1 on hv-cinder-85221 Aug 05 20:09:08.787367 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-123ac407-36af-483c-9f09-d59dc01a8790 req-797ea731-356c-4e23-a8dc-268be760170c service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036560 Aug 05 20:09:08.788006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 303/613] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:09:08.859037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:08.859635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:08.865764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:08.866243 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:08.866676 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:08.867358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:08.867833 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:08.868257 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:09.006668 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:09.010230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:09.015015 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-219cd673-33ef-4e81-b900-4615e9f4cf56 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1319 microversion: 2.1 time: 0.160382 Aug 05 20:09:09.015572 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 311/614] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:08 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:09.488461 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:09.489810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:09.497705 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:09.498325 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:09.499441 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:09.500346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:09.500730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:09.501134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:09.577058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:09.585881 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:09.587461 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:09.588594 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a576701b-952f-4d2d-8b6a-3d9dd4bf9089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1285 microversion: 2.20 time: 0.105778 Aug 05 20:09:09.589144 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 304/615] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:09 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:09.666273 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:09.667133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:09.674195 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:09.674676 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:09.675110 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:09.675816 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:09.676273 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:09.676692 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:09.877123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:09.884542 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-49c457e0-0279-4aee-9d4d-4b347e15fa2a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1366 microversion: 2.1 time: 0.222367 Aug 05 20:09:09.885105 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 312/616] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:09 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:10.036082 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:10.036683 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:10.043406 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:10.043929 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:10.044365 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:10.045051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:10.046023 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:10.046693 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:10.180785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:10.189164 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9e643d4c-e491-4fc0-9931-69c6874fc99a tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1507 microversion: 2.1 time: 0.156890 Aug 05 20:09:10.189773 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 305/617] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:10 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:10.211689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7dcdbc8e-056a-47fa-b673-5dbb177e6b6d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac772347-f399-48c0-a7b4-1e311c714e6b", "device": "/dev/sdb"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:10.214664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7dcdbc8e-056a-47fa-b673-5dbb177e6b6d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:10.221292 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7dcdbc8e-056a-47fa-b673-5dbb177e6b6d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:10.221780 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7dcdbc8e-056a-47fa-b673-5dbb177e6b6d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:10.222221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7dcdbc8e-056a-47fa-b673-5dbb177e6b6d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:10.222925 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7dcdbc8e-056a-47fa-b673-5dbb177e6b6d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:10.223380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7dcdbc8e-056a-47fa-b673-5dbb177e6b6d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:10.223842 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7dcdbc8e-056a-47fa-b673-5dbb177e6b6d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:10.612501 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:10.613268 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:10.619903 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:10.624780 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:10.626510 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:10.627700 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:10.628389 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:10.629312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:10.698798 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:10.698949 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7dcdbc8e-056a-47fa-b673-5dbb177e6b6d tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "POST /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491517 Aug 05 20:09:10.699669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 313/618] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:09:10 2022] POST /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:10.713653 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:10.715732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:10.717063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-517b5311-5288-4870-b652-a016a36ba731 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1339 microversion: 2.20 time: 0.109418 Aug 05 20:09:10.718148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 306/619] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:10 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:09:10.906963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:10.907649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:10.914367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:10.914997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:10.915435 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:10.916159 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:10.916861 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:10.917279 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:11.216427 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:11.225011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4d5c132a-4828-4d57-93de-1a3ebe10919a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1366 microversion: 2.1 time: 0.322707 Aug 05 20:09:11.225690 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 314/620] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:10 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:11.742761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:11.743387 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:11.750519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:11.751004 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:11.751451 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:11.752193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:11.752655 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:11.753088 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:12.138371 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:12.147326 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:12.148977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:12.150087 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fe94c9b0-6f61-4c75-b88e-63d570c9cacc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.411478 Aug 05 20:09:12.150656 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 307/621] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:11 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:12.245770 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:12.246373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:12.252926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:12.253410 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:12.253846 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:12.254576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:12.255027 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:12.255451 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:12.393711 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:12.401338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-067518ad-bb04-47a7-b455-aa168e004314 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1366 microversion: 2.1 time: 0.159430 Aug 05 20:09:12.401908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 315/622] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:12 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:13.173717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:13.174354 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:13.180370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:13.180844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:13.181275 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:13.181957 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:13.182412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:13.182830 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:13.318976 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:13.327534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:13.329096 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:13.330210 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-61e410d8-1e83-49ce-8d7e-50bcd990696c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.160879 Aug 05 20:09:13.330769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 308/623] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:13 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:13.423636 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:13.424333 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:13.431092 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:13.431579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:13.432035 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:13.432750 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:13.433204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:13.433624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:13.636621 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:13.645168 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d2f8d56f-17d5-4451-abc4-01d4e5dac730 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1366 microversion: 2.1 time: 0.225537 Aug 05 20:09:13.645760 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 316/624] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:13 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:13.865864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-a74182a2-933a-4cd8-be9a-23ed4dcbf647 req-dddce368-a94f-4401-aa94-b0290e6fa9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9126b58-ee6c-4974-ba02-f2d0384bbb90", "tag": "7ee1d147-d81b-4d46-a28d-f1a0289d9691"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:13.876170 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-a74182a2-933a-4cd8-be9a-23ed4dcbf647 req-dddce368-a94f-4401-aa94-b0290e6fa9f3 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:13.876654 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-a74182a2-933a-4cd8-be9a-23ed4dcbf647 req-dddce368-a94f-4401-aa94-b0290e6fa9f3 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:13.877105 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-a74182a2-933a-4cd8-be9a-23ed4dcbf647 req-dddce368-a94f-4401-aa94-b0290e6fa9f3 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:13.889919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-a74182a2-933a-4cd8-be9a-23ed4dcbf647 req-dddce368-a94f-4401-aa94-b0290e6fa9f3 service nova] Creating event network-changed:7ee1d147-d81b-4d46-a28d-f1a0289d9691 for instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 on hv-cinder-85221 Aug 05 20:09:13.895066 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-a74182a2-933a-4cd8-be9a-23ed4dcbf647 req-dddce368-a94f-4401-aa94-b0290e6fa9f3 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033579 Aug 05 20:09:13.895837 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 309/625] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:09:14.354963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:14.356122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:14.362473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:14.362989 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:14.363432 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:14.364215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:14.364671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:14.365099 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:14.497628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:14.506527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:14.508067 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:14.509174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b81ae722-d98d-4ba4-8108-e69a1c59c0f3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.160745 Aug 05 20:09:14.509734 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 317/626] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:14 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:14.666232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:14.667195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:14.674548 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:14.675035 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:14.675473 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:14.676209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:14.676666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:14.677092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:14.838971 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:14.847410 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ba0cc188-6a43-4fa6-a2ca-af267ab5cc53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1366 microversion: 2.1 time: 0.185308 Aug 05 20:09:14.848028 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 310/627] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:14 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:15.530678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:15.531306 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:15.537739 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:15.538224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:15.538660 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:15.539354 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:15.539824 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:15.540252 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:15.675393 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:15.683339 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:15.684874 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:15.685995 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6abef94e-41cb-4c40-b99d-d9a00a2b8714 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.159354 Aug 05 20:09:15.687245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 318/628] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:15 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:15.869160 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:15.869679 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:15.876907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:15.877390 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:15.877819 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:15.878512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:15.878963 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:15.879387 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:16.010025 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:16.017966 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-dc8fbc09-348f-4591-86c7-fd15d64725a8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1366 microversion: 2.1 time: 0.152762 Aug 05 20:09:16.018535 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 311/629] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:15 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:16.394148 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-74fc848b-80a9-457f-8503-41f8ffda4ef4 req-b968c144-6ea5-416a-9856-3fccd4306356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad207769-9bf5-4536-aa34-9551111c85e1", "name": "network-vif-plugged", "status": "completed", "tag": "680925df-cba7-4d99-b3aa-9bbe2b6329d9"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:16.401716 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=6 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:16.404605 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-74fc848b-80a9-457f-8503-41f8ffda4ef4 req-b968c144-6ea5-416a-9856-3fccd4306356 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:16.405551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-74fc848b-80a9-457f-8503-41f8ffda4ef4 req-b968c144-6ea5-416a-9856-3fccd4306356 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:16.406535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-74fc848b-80a9-457f-8503-41f8ffda4ef4 req-b968c144-6ea5-416a-9856-3fccd4306356 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:16.426543 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-74fc848b-80a9-457f-8503-41f8ffda4ef4 req-b968c144-6ea5-416a-9856-3fccd4306356 service nova] Creating event network-vif-plugged:680925df-cba7-4d99-b3aa-9bbe2b6329d9 for instance ad207769-9bf5-4536-aa34-9551111c85e1 on hv-cinder-85221 Aug 05 20:09:16.435158 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-74fc848b-80a9-457f-8503-41f8ffda4ef4 req-b968c144-6ea5-416a-9856-3fccd4306356 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046449 Aug 05 20:09:16.436045 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 319/630] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:16.709243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:16.710130 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:16.716370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:16.716864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:16.717308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:16.718647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:16.719111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:16.719545 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:16.724100 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:16.852760 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:16.862116 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:16.863564 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:16.864720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-23278c9e-6dc5-484d-adc5-012ac78677e0 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.159430 Aug 05 20:09:16.865511 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 312/631] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:16 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:17.039807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:17.040533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:17.047543 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:17.048113 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:17.048792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:17.049174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:17.049624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:17.050041 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:17.180459 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:17.187860 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b1e032dc-ff25-452c-bd49-7c7e96f7f731 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1366 microversion: 2.1 time: 0.152805 Aug 05 20:09:17.188424 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 320/632] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:17 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:17.947224 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:17.947873 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:17.954734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:17.955222 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:17.955658 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:17.956401 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:17.956859 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:17.957281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:18.093637 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:18.102319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:18.104053 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:18.105174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9831fc7c-5da1-4f95-a502-df43cdff12be tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.220565 Aug 05 20:09:18.105935 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 313/633] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:17 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:18.208940 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:18.209577 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:18.216052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:18.216546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:18.216987 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:18.218393 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:18.218968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:18.219292 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:18.472183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-15f1617b-d3db-410a-96fe-400870a4e250 req-4bb9a69e-8d80-48bc-98d8-ee6fcc5d5e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9126b58-ee6c-4974-ba02-f2d0384bbb90", "name": "network-vif-plugged", "status": "completed", "tag": "7ee1d147-d81b-4d46-a28d-f1a0289d9691"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:18.477546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=4 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:18.478341 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=20 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:18.486340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-15f1617b-d3db-410a-96fe-400870a4e250 req-4bb9a69e-8d80-48bc-98d8-ee6fcc5d5e97 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:18.486936 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-15f1617b-d3db-410a-96fe-400870a4e250 req-4bb9a69e-8d80-48bc-98d8-ee6fcc5d5e97 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:18.487561 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-15f1617b-d3db-410a-96fe-400870a4e250 req-4bb9a69e-8d80-48bc-98d8-ee6fcc5d5e97 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:18.500380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-15f1617b-d3db-410a-96fe-400870a4e250 req-4bb9a69e-8d80-48bc-98d8-ee6fcc5d5e97 service nova] Creating event network-vif-plugged:7ee1d147-d81b-4d46-a28d-f1a0289d9691 for instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 on hv-cinder-85221 Aug 05 20:09:18.505462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-15f1617b-d3db-410a-96fe-400870a4e250 req-4bb9a69e-8d80-48bc-98d8-ee6fcc5d5e97 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037815 Aug 05 20:09:18.506424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 314/634] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:18.601480 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:18.609862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-63f071a1-28fd-494e-9da8-5145868efe87 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1366 microversion: 2.1 time: 0.404942 Aug 05 20:09:18.610431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 321/635] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:18 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:19.130154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:19.130760 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:19.136855 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:19.137332 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:19.137765 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:19.138441 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:19.138891 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:19.139402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:19.273130 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:19.281719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:19.283254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:19.284397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1def22fa-e397-4ff6-9fdc-acc792b4681a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.159069 Aug 05 20:09:19.284963 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 315/636] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:19 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:19.630509 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:19.631120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:19.637598 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:19.638088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:19.638630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:19.640039 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:19.641086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:19.642245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:19.773409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:19.781901 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7c835104-faef-4816-b94f-175dc2aeaebc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1557 microversion: 2.1 time: 0.155276 Aug 05 20:09:19.782492 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 322/637] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:19 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:19.802065 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1204c58b-5c88-48fc-ad9b-83e66eb3e0e6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:19.802553 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1204c58b-5c88-48fc-ad9b-83e66eb3e0e6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:19.808470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1204c58b-5c88-48fc-ad9b-83e66eb3e0e6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:19.808951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1204c58b-5c88-48fc-ad9b-83e66eb3e0e6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:19.809404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1204c58b-5c88-48fc-ad9b-83e66eb3e0e6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:19.810058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1204c58b-5c88-48fc-ad9b-83e66eb3e0e6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:19.810509 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1204c58b-5c88-48fc-ad9b-83e66eb3e0e6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:19.810929 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1204c58b-5c88-48fc-ad9b-83e66eb3e0e6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:19.890804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1204c58b-5c88-48fc-ad9b-83e66eb3e0e6 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092393 Aug 05 20:09:19.891396 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 316/638] 10.222.0.95 () {58 vars in 1275 bytes} [Fri Aug 5 20:09:19 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:20.310782 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:20.311609 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:20.320729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:20.321334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:20.321856 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:20.322920 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:20.335489 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:20.335489 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:20.475430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:20.484878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:20.486872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:20.488045 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e51bc651-cc5b-4e7e-98af-802cfd0684fc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.183510 Aug 05 20:09:20.491937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 323/639] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:20 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:20.869785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-a92c42d5-26a6-42ed-a35d-c9a48e5192f5 req-df4483b3-243c-4ca8-bdc1-54915977437e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad207769-9bf5-4536-aa34-9551111c85e1", "tag": "680925df-cba7-4d99-b3aa-9bbe2b6329d9"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:20.880685 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-a92c42d5-26a6-42ed-a35d-c9a48e5192f5 req-df4483b3-243c-4ca8-bdc1-54915977437e service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:20.881172 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-a92c42d5-26a6-42ed-a35d-c9a48e5192f5 req-df4483b3-243c-4ca8-bdc1-54915977437e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:20.881615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-a92c42d5-26a6-42ed-a35d-c9a48e5192f5 req-df4483b3-243c-4ca8-bdc1-54915977437e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:20.894123 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-a92c42d5-26a6-42ed-a35d-c9a48e5192f5 req-df4483b3-243c-4ca8-bdc1-54915977437e service nova] Creating event network-changed:680925df-cba7-4d99-b3aa-9bbe2b6329d9 for instance ad207769-9bf5-4536-aa34-9551111c85e1 on hv-cinder-85221 Aug 05 20:09:20.898954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-a92c42d5-26a6-42ed-a35d-c9a48e5192f5 req-df4483b3-243c-4ca8-bdc1-54915977437e service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032669 Aug 05 20:09:20.899555 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 317/640] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:21.510913 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:21.511627 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:21.518667 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:21.519156 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:21.519595 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:21.520325 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:21.520777 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:21.521201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:21.665437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:21.677397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:21.679618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:21.680744 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d5786c19-0de7-4ca5-974b-e5ee6b7afe83 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.174080 Aug 05 20:09:21.681318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 324/641] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:21 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:22.703894 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:22.704783 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:22.711427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:22.711967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:22.712416 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:22.713127 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:22.713625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:22.714018 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:22.863528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:22.871432 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:22.872991 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:22.875162 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bb873010-628f-4b13-9960-bdb4d3008eb7 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1407 microversion: 2.20 time: 0.176042 Aug 05 20:09:22.875724 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 318/642] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:22 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:23.897862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:23.898472 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:23.905461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:23.906100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:23.906545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:23.907295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:23.907799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:23.908230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:24.050735 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:24.058557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:24.060121 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:24.061997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b69cc107-9423-4724-907f-eda202ecf591 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1598 microversion: 2.20 time: 0.168014 Aug 05 20:09:24.062607 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 325/643] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:23 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:24.084662 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-36acaa30-2e3f-4733-a144-60b4a991690f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:24.085154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-36acaa30-2e3f-4733-a144-60b4a991690f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:24.091669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-36acaa30-2e3f-4733-a144-60b4a991690f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:24.092287 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-36acaa30-2e3f-4733-a144-60b4a991690f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:24.092761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-36acaa30-2e3f-4733-a144-60b4a991690f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:24.093459 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-36acaa30-2e3f-4733-a144-60b4a991690f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:24.093920 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-36acaa30-2e3f-4733-a144-60b4a991690f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:24.094351 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-36acaa30-2e3f-4733-a144-60b4a991690f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:24.106325 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2e69411f-355d-4524-8668-73a607199561 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21ec4d68-6b9f-453b-86fa-13f293945717"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:24.108828 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2e69411f-355d-4524-8668-73a607199561 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:24.114817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e69411f-355d-4524-8668-73a607199561 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:24.115307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e69411f-355d-4524-8668-73a607199561 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:24.115745 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e69411f-355d-4524-8668-73a607199561 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:24.116467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e69411f-355d-4524-8668-73a607199561 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:24.116923 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e69411f-355d-4524-8668-73a607199561 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:24.117347 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2e69411f-355d-4524-8668-73a607199561 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:24.173482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-36acaa30-2e3f-4733-a144-60b4a991690f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092753 Aug 05 20:09:24.174256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 319/644] 10.222.0.95 () {60 vars in 1316 bytes} [Fri Aug 5 20:09:24 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:09:25.103145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-bd2e03ee-43fe-44d5-9c67-84d495a2c2f6 req-a36d3e99-b886-4807-a3d6-3f31275c2af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9126b58-ee6c-4974-ba02-f2d0384bbb90", "tag": "7ee1d147-d81b-4d46-a28d-f1a0289d9691"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:25.112788 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-bd2e03ee-43fe-44d5-9c67-84d495a2c2f6 req-a36d3e99-b886-4807-a3d6-3f31275c2af8 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:25.113346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-bd2e03ee-43fe-44d5-9c67-84d495a2c2f6 req-a36d3e99-b886-4807-a3d6-3f31275c2af8 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:25.113845 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-bd2e03ee-43fe-44d5-9c67-84d495a2c2f6 req-a36d3e99-b886-4807-a3d6-3f31275c2af8 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:25.124593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-bd2e03ee-43fe-44d5-9c67-84d495a2c2f6 req-a36d3e99-b886-4807-a3d6-3f31275c2af8 service nova] Creating event network-changed:7ee1d147-d81b-4d46-a28d-f1a0289d9691 for instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 on hv-cinder-85221 Aug 05 20:09:25.129735 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-bd2e03ee-43fe-44d5-9c67-84d495a2c2f6 req-a36d3e99-b886-4807-a3d6-3f31275c2af8 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030872 Aug 05 20:09:25.130397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 320/645] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:09:27.760626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:27.780118 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2e69411f-355d-4524-8668-73a607199561 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.677451 Aug 05 20:09:27.780742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 326/646] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:09:24 2022] POST /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 194 bytes in 3679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:09:35.476873 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:35.477647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=36 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:35.482888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:35.483462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:35.491418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:35.491950 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:35.492400 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:35.493107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:35.493589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:35.494022 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:35.575086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lazy-loading 'services' on Instance uuid d920859b-d29e-4bac-8e7b-000a2684631f {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:09:35.647393 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-153bca03-6e08-4f90-87fa-d3aeaff65721 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "DELETE /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f/os-volume_attachments/ac772347-f399-48c0-a7b4-1e311c714e6b" status: 202 len: 0 microversion: 2.1 time: 0.171877 Aug 05 20:09:35.648032 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 321/647] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:09:35 2022] DELETE /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f/os-volume_attachments/ac772347-f399-48c0-a7b4-1e311c714e6b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:09:39.548189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:39.550543 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:39.553051 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:39.553823 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:39.560756 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:39.561369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:39.562006 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:39.562712 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:39.563166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:39.563594 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:39.587490 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lazy-loading 'flavor' on Instance uuid 855b7a0d-cc32-490d-90c5-abb6c7b3a67b {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:09:39.722432 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d33c30e5-b469-47f4-9730-da63e7e9f800 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/action" status: 200 len: 32 microversion: 2.1 time: 0.178722 Aug 05 20:09:39.723014 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 327/648] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:09:39 2022] POST /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:09:39.734567 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:39.735979 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:39.743712 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:39.744245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:39.744685 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:39.745887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:39.746019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:39.746414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:39.903115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:39.911265 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-daa01adc-2401-49ed-9dd7-f4b44781f9f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.182452 Aug 05 20:09:39.912010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 322/649] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:39 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:40.934604 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:40.935374 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:40.941719 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:40.942204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:40.942636 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:40.943318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:40.943763 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:40.944206 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.021429 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:41.021971 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:41.028251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.028735 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.029231 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.030219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.030681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.031108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.056870 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:09:41.078541 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:41.086394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-528575d6-997b-493e-adde-e69ffc1d518f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.156464 Aug 05 20:09:41.087146 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 328/650] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:40 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:41.133077 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8be16a63-a36e-443e-835a-8e1f96397a93 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "DELETE /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 204 len: 0 microversion: 2.1 time: 0.115095 Aug 05 20:09:41.133743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 323/651] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:09:41 2022] DELETE /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:09:41.143468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:41.144102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:41.150041 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.150528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.150966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.151650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.152129 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.152557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.284833 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:41.292871 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-01a90c72-c74a-41c1-816d-6d9419bc1e5e tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1513 microversion: 2.1 time: 0.154174 Aug 05 20:09:41.293436 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 329/652] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:41 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:42.110151 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:42.111108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:42.117522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:42.118007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:42.118442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:42.119133 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:42.119585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:42.120044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:42.253252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:42.261294 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0cc3a9d8-4910-483e-b28d-db231b9e2fc4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.156116 Aug 05 20:09:42.261870 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 324/653] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:42 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:42.313756 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:42.314365 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:42.320734 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:42.321221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:42.321658 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:42.322348 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:42.322807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:42.323232 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:42.452794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:42.460373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e503a7d5-de2a-4d8b-a82c-183c111b8de8 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1513 microversion: 2.1 time: 0.150521 Aug 05 20:09:42.461222 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 330/654] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:42 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:43.288243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:43.288793 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:43.295097 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:43.295574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:43.296029 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:43.296713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:43.297162 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:43.297582 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:43.431346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:43.440311 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-83a01dbb-8004-40e4-a7a7-b3a5cbab0ae4 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.156103 Aug 05 20:09:43.440922 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 325/655] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:43 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:43.481265 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:43.481874 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:43.488430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:43.488919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:43.489380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:43.490071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:43.490524 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:43.490948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:43.627521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:43.634944 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-af530bb6-40e0-4264-a04f-aadf660ad952 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1513 microversion: 2.1 time: 0.157485 Aug 05 20:09:43.635515 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 331/656] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:43 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:44.257830 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-fd626f4b-db37-4d2c-ad90-295219285da9 req-904ce292-df93-437a-865b-a71d38bf45df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d920859b-d29e-4bac-8e7b-000a2684631f", "name": "network-vif-deleted", "tag": "022ca850-433b-4d4b-a726-81ce11fcfd91"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:44.267317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-fd626f4b-db37-4d2c-ad90-295219285da9 req-904ce292-df93-437a-865b-a71d38bf45df service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.267819 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-fd626f4b-db37-4d2c-ad90-295219285da9 req-904ce292-df93-437a-865b-a71d38bf45df service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.268263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-fd626f4b-db37-4d2c-ad90-295219285da9 req-904ce292-df93-437a-865b-a71d38bf45df service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.279674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-fd626f4b-db37-4d2c-ad90-295219285da9 req-904ce292-df93-437a-865b-a71d38bf45df service nova] Creating event network-vif-deleted:022ca850-433b-4d4b-a726-81ce11fcfd91 for instance d920859b-d29e-4bac-8e7b-000a2684631f on hv-cinder-85221 Aug 05 20:09:44.284659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-fd626f4b-db37-4d2c-ad90-295219285da9 req-904ce292-df93-437a-865b-a71d38bf45df service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086800 Aug 05 20:09:44.285475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 326/657] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:44.461773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:44.462386 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:44.469335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.469826 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.470295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.470988 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.471447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.471912 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.608534 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:44.616468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c3e75070-f15b-4a4c-be89-e37d42a0620b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.158543 Aug 05 20:09:44.617038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 332/658] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:44 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:44.658645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:44.659380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:44.665844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.666354 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.666790 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.667477 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.667981 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.668410 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.698274 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.698675 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.699111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.699552 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lazy-loading 'fault' on Instance uuid d920859b-d29e-4bac-8e7b-000a2684631f {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:09:44.742016 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b2fcb1887f749dcb488c63054290a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c8d8166fe14ab5a1651d0d48dff37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:44.750122 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-87622097-dbf7-4ea0-9ba6-0e3ed58e4ffc tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 200 len: 1309 microversion: 2.1 time: 0.096702 Aug 05 20:09:44.750693 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 327/659] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:44 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:45.637747 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:45.638518 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:45.645071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:45.645555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:45.645991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:45.646679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:45.647134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:45.647566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:45.771064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:45.771698 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] [instance: d920859b-d29e-4bac-8e7b-000a2684631f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:45.774942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:45.778504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:45.779710 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:45.780180 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:45.780900 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:45.781355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:45.781780 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:45.783708 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2c3bdf4a-97e7-4f7e-89c0-f6477db6e332 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.149802 Aug 05 20:09:45.784312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 333/660] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:45 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:45.796496 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] HTTP exception thrown: Instance d920859b-d29e-4bac-8e7b-000a2684631f could not be found. Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Request method failure captured: Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f HTTP/1.1 Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7Xhv_P4qH7Uro5HEBDgHmnffYs1yU44wnLC_mLvuGrbUobrCTDNtioDQBcSIyz6SqorTedMKpuC7Ieidk1ZJX1kbC1NM1ZiThZnTsUv0EQTHy2u6EZlSzQVdx3JwBNlLt2fF3CFPXT2Z8QmUB2VXWsd17uh7pPxEcvV8a0atWtFWRqk Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 62c8d8166fe14ab5a1651d0d48dff37a Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-VolumesSnapshotTestJSON-17205259 Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:09:45.798154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/62c8d8166fe14ab5a1651d0d48dff37a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_62c8d8166fe14ab5a1651d0d48dff37a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/62c8d8166fe14ab5a1651d0d48dff37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/62c8d8166fe14ab5a1651d0d48dff37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-VolumesSnapshotTestJSON-17205259 Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 62c8d8166fe14ab5a1651d0d48dff37a Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-17205259 Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-VolumesSnapshotTestJSON-17205259-project Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 3b2fcb1887f749dcb488c63054290a45 Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-VolumesSnapshotTestJSON-17205259-project Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance d920859b-d29e-4bac-8e7b-000a2684631f could not be found. Aug 05 20:09:45.799593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'd920859b-d29e-4bac-8e7b-000a2684631f'} Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d920859b-d29e-4bac-8e7b-000a2684631f could not be found. Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:09:45.800479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d920859b-d29e-4bac-8e7b-000a2684631f could not be found. Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d920859b-d29e-4bac-8e7b-000a2684631f could not be found. Aug 05 20:09:45.801958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:09:45.803213 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] Returning 404 to user: Instance d920859b-d29e-4bac-8e7b-000a2684631f could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:09:45.803213 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-288b45a1-e9a1-4f83-9acc-eac499633180 tempest-VolumesSnapshotTestJSON-17205259 tempest-VolumesSnapshotTestJSON-17205259-project] 10.222.0.95 "GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f" status: 404 len: 111 microversion: 2.1 time: 0.032419 Aug 05 20:09:45.803213 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 328/661] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:45 2022] GET /compute/v2.1/servers/d920859b-d29e-4bac-8e7b-000a2684631f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:09:46.806896 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:46.807431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:46.813933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:46.814423 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:46.814868 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:46.815562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:46.816053 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:46.816487 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:46.947845 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:46.956464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-86b71d1c-49ce-4344-9dd9-9afb253a7d3d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.153527 Aug 05 20:09:46.957037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 334/662] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:46 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:47.977919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:47.978532 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:47.985801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:47.986316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:47.986756 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:47.987442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:47.987932 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:47.988362 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:48.119310 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:48.128165 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ce14ddd3-cf0f-4957-9108-c8d2c8e64e76 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.154049 Aug 05 20:09:48.128733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 329/663] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:47 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:49.149187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:49.149789 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:49.156878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:49.157355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:49.157782 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:49.158459 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:49.158908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:49.159325 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:49.288841 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:49.297304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c033f116-ebbc-411d-97db-fd2a97d58f5e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.152024 Aug 05 20:09:49.297870 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 335/664] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:49 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:50.319830 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:50.320450 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:50.327951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:50.328444 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:50.328887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:50.329588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:50.330048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:50.330477 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:50.465802 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:50.474414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-171f30a0-28ac-4131-9787-288a02ca8059 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.159758 Aug 05 20:09:50.474986 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 330/665] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:50 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:51.496586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:51.497199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:51.504754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:51.505252 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:51.505696 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:51.506396 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:51.506856 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:51.507288 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:51.642691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:51.650724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5c3797b5-9c45-4728-9475-6eddf179461c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.158000 Aug 05 20:09:51.651380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 336/666] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:51 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:52.672800 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:52.673405 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:52.679920 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:52.680348 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:52.680786 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:52.681479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:52.681932 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:52.682360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:52.814684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:52.822510 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f7f5b649-e1f8-4d21-9e60-4e0d43417443 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.154174 Aug 05 20:09:52.823311 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 331/667] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:52 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:53.844106 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:53.844718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:53.851122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:53.851609 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:53.852084 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:53.852774 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:53.853229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:53.853657 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:53.986993 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:53.995010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d3ec6b17-b13d-4fc4-ab3d-14b8e4b6628f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.155408 Aug 05 20:09:53.995573 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 337/668] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:53 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:55.016310 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:55.016849 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:55.023228 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:55.023743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:55.024188 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:55.024882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:55.025338 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:55.025765 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:55.161645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:55.169783 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3c41f87b-3e1a-4314-ba06-edbf1aa3c5ae tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.158116 Aug 05 20:09:55.170353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 332/669] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:55 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:56.190523 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:56.191171 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:56.199187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:56.199677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:56.200202 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:56.200918 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:56.201401 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:56.201887 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:56.338486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:56.347008 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-85d98bb1-baf3-4de3-952c-3ac079941d41 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.160307 Aug 05 20:09:56.347569 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 338/670] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:56 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:57.369209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:57.369816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:57.376349 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:57.376843 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:57.377327 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:57.378023 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:57.378480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:57.378913 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:57.508614 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:57.517260 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-625536c9-2280-4819-959d-2468070db8ca tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.151934 Aug 05 20:09:57.517829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 333/671] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:57 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:58.538493 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:58.539136 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:58.547014 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:58.547499 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:58.547976 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:58.548678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:58.549135 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:58.549562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:58.684621 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:58.692996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-88232dc2-16e6-4db4-9657-87b736b20ee6 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.158419 Aug 05 20:09:58.693547 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 339/672] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:58 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:59.714560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:59.715108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:59.722083 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:59.722662 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:59.723177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:59.723917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:59.724385 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:59.724816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:00.090981 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:00.099080 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-84ec3152-d4b9-43aa-aeda-4a7deaa82e06 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.388339 Aug 05 20:10:00.099676 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 334/673] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:59 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:01.120172 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:01.120792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:01.128048 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:01.128543 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:01.129064 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:01.129840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:01.130303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:01.130736 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:01.275882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:01.285792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9237eb5b-6f76-4450-ba8c-035b53fb54ef tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.169332 Aug 05 20:10:01.286375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 340/674] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:01 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:02.308033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:02.308643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:02.316339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:02.316839 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:02.317282 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:02.318001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:02.318443 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:02.318875 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:02.454984 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:02.462836 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ce2543b5-7d9f-410a-865a-8ae48802337a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.159176 Aug 05 20:10:02.463412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 335/675] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:02 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:03.484491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:03.485137 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:03.491568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:03.492101 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:03.492547 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:03.493245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:03.493708 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:03.494138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:03.515038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:03.655880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:03.665511 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6d88a8b9-e359-4e06-847c-acf7c7ef678b tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.184952 Aug 05 20:10:03.666092 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 341/676] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:03 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:04.687106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:04.687651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:04.694146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:04.694626 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:04.695065 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:04.695761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:04.696238 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:04.696666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:04.701273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:04.834934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:04.843529 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1d75f797-9b13-4e4d-b8bf-6d55eff31686 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.160347 Aug 05 20:10:04.844153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 336/677] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:04 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:05.865770 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:05.866380 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:05.874642 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:05.875448 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:05.877230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:05.878009 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:05.878115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:05.878555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:06.030131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:06.038340 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0d570457-d1fe-4118-b77b-66dfd19464d0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.177145 Aug 05 20:10:06.038929 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 342/678] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:05 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:07.065236 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:07.065758 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:07.068112 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:07.073250 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.073738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.074179 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.075061 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.075612 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.075993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.227545 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:07.237177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-81896e67-c91d-4b17-9c42-9a1b2143594d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.175851 Aug 05 20:10:07.237764 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 337/679] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:07 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:07.491166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6e94aa06-26d3-4bee-bab8-e0f2152d6986 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:07.491666 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6e94aa06-26d3-4bee-bab8-e0f2152d6986 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:07.497672 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e94aa06-26d3-4bee-bab8-e0f2152d6986 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.498168 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e94aa06-26d3-4bee-bab8-e0f2152d6986 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.498605 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e94aa06-26d3-4bee-bab8-e0f2152d6986 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.499318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e94aa06-26d3-4bee-bab8-e0f2152d6986 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.499755 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e94aa06-26d3-4bee-bab8-e0f2152d6986 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.500211 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e94aa06-26d3-4bee-bab8-e0f2152d6986 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.522848 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6e94aa06-26d3-4bee-bab8-e0f2152d6986 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/ips" status: 200 len: 151 microversion: 2.1 time: 0.090212 Aug 05 20:10:07.523404 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 343/680] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:10:07 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/ips => generated 151 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:08.259918 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:08.260528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:08.270003 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.270600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.270986 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.271681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.272159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.272585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.407417 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:08.415501 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-857bd580-cd5d-41da-8bd5-952605dd69f0 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.159581 Aug 05 20:10:08.416113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 338/681] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:08 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:08.865465 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5f7d8b67-f3db-4041-93ac-e98c95463b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "987bbe46-5a54-4f2e-b147-b60dc3666adb"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:08.867911 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5f7d8b67-f3db-4041-93ac-e98c95463b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:08.874127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f7d8b67-f3db-4041-93ac-e98c95463b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.874615 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f7d8b67-f3db-4041-93ac-e98c95463b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.875051 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f7d8b67-f3db-4041-93ac-e98c95463b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.875740 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f7d8b67-f3db-4041-93ac-e98c95463b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.876392 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f7d8b67-f3db-4041-93ac-e98c95463b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.876655 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f7d8b67-f3db-4041-93ac-e98c95463b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:09.149149 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5f7d8b67-f3db-4041-93ac-e98c95463b5d tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287138 Aug 05 20:10:09.149811 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 344/682] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:10:08 2022] POST /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:09.437828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:09.438523 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:09.445155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:09.445738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:09.446342 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:09.447256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:09.447829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:09.448461 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:09.684863 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:09.693038 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0ad17b52-bfbc-4bd0-9bfd-e6f8645ff927 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.259449 Aug 05 20:10:09.693614 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 339/683] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:09 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:09.904437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f493e277-bd44-4563-baa7-5dcd536f9b82 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:09.905132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f493e277-bd44-4563-baa7-5dcd536f9b82 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:09.908767 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=37 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:09.927828 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f493e277-bd44-4563-baa7-5dcd536f9b82 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:09.928239 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f493e277-bd44-4563-baa7-5dcd536f9b82 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:09.928681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f493e277-bd44-4563-baa7-5dcd536f9b82 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:09.929394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f493e277-bd44-4563-baa7-5dcd536f9b82 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:09.929886 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f493e277-bd44-4563-baa7-5dcd536f9b82 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:09.930316 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f493e277-bd44-4563-baa7-5dcd536f9b82 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:09.956933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f493e277-bd44-4563-baa7-5dcd536f9b82 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/ips" status: 200 len: 151 microversion: 2.20 time: 0.057203 Aug 05 20:10:09.957488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 345/684] 10.222.0.95 () {60 vars in 1289 bytes} [Fri Aug 5 20:10:09 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:10:10.716950 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:10.717937 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:10.726025 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:10.726528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:10.726965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:10.727914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:10.728328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:10.728767 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:10.871265 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:10.881249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bf865011-679e-4ad0-8d2f-eda2dd297c26 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.168624 Aug 05 20:10:10.881249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 340/685] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:10 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:11.902121 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:11.903273 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:11.909582 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:11.910187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:11.910514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:11.911415 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:11.912079 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:11.912743 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.158491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:12.171424 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-88d07db4-a212-44b0-9853-64c026e87cdf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.273183 Aug 05 20:10:12.172598 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 346/686] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:11 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:12.487225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:12.488449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:12.500553 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.501235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.501674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.502879 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.503507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.504122 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.536970 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lazy-loading 'flavor' on Instance uuid f9126b58-ee6c-4974-ba02-f2d0384bbb90 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:10:12.774155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8385a92c-782d-4551-8971-3b2442da6a7a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/action" status: 202 len: 0 microversion: 2.20 time: 0.291479 Aug 05 20:10:12.775221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 341/687] 10.222.0.95 () {62 vars in 1319 bytes} [Fri Aug 5 20:10:12 2022] POST /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:10:12.783973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:12.784938 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:12.792348 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.793224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.794269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.795123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.795720 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.796258 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:13.025935 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:13.034911 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:13.036484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:13.037839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f4379dbf-190a-49b5-a8ea-b6457b7e5e87 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.257731 Aug 05 20:10:13.038836 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 347/688] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:12 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:13.195577 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:13.196463 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:13.204083 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:13.204446 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:13.204889 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:13.205598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:13.206062 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:13.206492 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:13.355020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:13.363795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1c0afe93-dfb3-4d92-ac2a-d28d5a57d610 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.172889 Aug 05 20:10:13.364685 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 342/689] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:13 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:14.061724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:14.062901 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:14.069395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:14.070119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:14.070710 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:14.071571 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:14.072238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:14.072681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:14.222886 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:14.237397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:14.239346 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:14.240794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-500456b4-0c52-4ad6-ab64-b3168e4fba4f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.183126 Aug 05 20:10:14.256954 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 348/690] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:14 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:14.388956 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:14.390156 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:14.403574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:14.405814 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:14.407050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:14.409556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:14.411327 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:14.411771 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:14.781556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:14.792890 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c553d8a4-6754-49de-8d97-ad27172c3ff7 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1736 microversion: 2.1 time: 0.411350 Aug 05 20:10:14.806275 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 343/691] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:14 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1736 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:15.270923 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:15.272310 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:15.279767 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:15.280292 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:15.280739 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:15.281450 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:15.282102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:15.282525 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:15.445907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:15.456050 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:15.457785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:15.459161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8792fd62-55ed-4e9a-9992-336e19729384 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.192110 Aug 05 20:10:15.472673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 349/692] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:15 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:15.814648 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:15.815322 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:15.823071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:15.823725 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:15.824334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:15.825308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:15.825838 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:15.826288 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:15.970177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:15.979534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c96da4a5-3523-4678-9eeb-332d279e275c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1716 microversion: 2.1 time: 0.168986 Aug 05 20:10:15.992010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 344/693] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:15 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1716 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:16.126545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:16.127183 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:16.134609 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.135931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.136382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.138313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.138780 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.139210 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.240705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] HTTP exception thrown: Cannot 'detach_volume' instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b while it is in vm_state rescued Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Request method failure captured: Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments/21ec4d68-6b9f-453b-86fa-13f293945717 HTTP/1.1 Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XgRdLYKXftSa7cksEAGEmp9Unty8uOHU92P1vhQu2l3nZ6lO4VbDxcp7avQ4TWjJyMjr4KUEYOhJEFSxdqwjwJlC-cSJE7I6c0xXnOWqEBh2Uawuw3PrqmHgcR9ArEHNKV9QL8Mp0h54jpdsmhpmyPQvKUIUi3JBGRjdgvbcu-uHyY Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:10:16.243198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_573a75f13f7240479c725daba27011bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/573a75f13f7240479c725daba27011bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 10705004cfd74f0caddef9db51f1a52c Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:10:16.244875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Cannot 'detach_volume' instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b while it is in vm_state rescued Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'server_id': '855b7a0d-cc32-490d-90c5-abb6c7b3a67b', 'id': '21ec4d68-6b9f-453b-86fa-13f293945717'} Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:10:16.245840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b while it is in vm_state rescued Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b while it is in vm_state rescued Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:16.247481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Returning 409 to user: Cannot 'detach_volume' instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b while it is in vm_state rescued {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:10:16.249211 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b1a5fb13-5555-4cb6-9b14-bf2c47cd160c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "DELETE /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments/21ec4d68-6b9f-453b-86fa-13f293945717" status: 409 len: 152 microversion: 2.1 time: 0.126842 Aug 05 20:10:16.252576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 350/694] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:10:16 2022] DELETE /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments/21ec4d68-6b9f-453b-86fa-13f293945717 => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 20:10:16.259651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bc470e13-2312-46b2-8ee4-81667a5e5e79 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:16.260404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bc470e13-2312-46b2-8ee4-81667a5e5e79 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:16.267832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bc470e13-2312-46b2-8ee4-81667a5e5e79 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.268765 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bc470e13-2312-46b2-8ee4-81667a5e5e79 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.269393 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bc470e13-2312-46b2-8ee4-81667a5e5e79 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.270149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bc470e13-2312-46b2-8ee4-81667a5e5e79 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.270999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bc470e13-2312-46b2-8ee4-81667a5e5e79 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.273385 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bc470e13-2312-46b2-8ee4-81667a5e5e79 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.355166 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bc470e13-2312-46b2-8ee4-81667a5e5e79 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "POST /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/action" status: 202 len: 0 microversion: 2.1 time: 0.100335 Aug 05 20:10:16.360480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 345/695] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:10:16 2022] POST /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:10:16.365616 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:16.366890 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:16.378649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.379104 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.379653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.380504 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.381033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.381562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.484012 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:16.484787 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:16.491713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.492730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.493172 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.493867 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.494489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.494924 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.634930 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:16.650204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-13dfd6e7-3a1c-4e46-979f-b24e783900b5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1724 microversion: 2.1 time: 0.288654 Aug 05 20:10:16.650784 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 351/696] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:16 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:16.859170 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "987bbe46-5a54-4f2e-b147-b60dc3666adb"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:16.860451 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:16.863066 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:16.870479 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.871009 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.872222 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.873112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.873714 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.874284 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.880968 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:16.882520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:16.883713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d56afbdf-3335-4cfc-bc73-8695601cf452 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.404547 Aug 05 20:10:16.885263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 346/697] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:16 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:17.024461 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Invalid volume: volume 987bbe46-5a54-4f2e-b147-b60dc3666adb is already attached to instances: ad207769-9bf5-4536-aa34-9551111c85e1 Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: POST /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments HTTP/1.1 Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 74 Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:10:17.026589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {"volumeAttachment": {"volumeId": "987bbe46-5a54-4f2e-b147-b60dc3666adb"}} Aug 05 20:10:17.029086 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Invalid volume: volume 987bbe46-5a54-4f2e-b147-b60dc3666adb is already attached to instances: ad207769-9bf5-4536-aa34-9551111c85e1 Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'server_id': 'ad207769-9bf5-4536-aa34-9551111c85e1', 'body': {'volumeAttachment': {'volumeId': '987bbe46-5a54-4f2e-b147-b60dc3666adb'}}} Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 987bbe46-5a54-4f2e-b147-b60dc3666adb is already attached to instances: ad207769-9bf5-4536-aa34-9551111c85e1 Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:17.029908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 987bbe46-5a54-4f2e-b147-b60dc3666adb is already attached to instances: ad207769-9bf5-4536-aa34-9551111c85e1 Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:17.031069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:17.033551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:17.033551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:10:17.033551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:10:17.033551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 987bbe46-5a54-4f2e-b147-b60dc3666adb is already attached to instances: ad207769-9bf5-4536-aa34-9551111c85e1 Aug 05 20:10:17.033551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:17.034946 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 400 to user: Invalid volume: volume 987bbe46-5a54-4f2e-b147-b60dc3666adb is already attached to instances: ad207769-9bf5-4536-aa34-9551111c85e1 {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:10:17.041413 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5ec45707-2124-4a0d-92c3-8264207145d1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.186724 Aug 05 20:10:17.046477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 352/698] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:10:16 2022] POST /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments => generated 174 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:10:17.120060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:17.120564 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:17.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.128014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.129222 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.132052 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.132532 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.132967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.288214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'services' on Instance uuid ad207769-9bf5-4536-aa34-9551111c85e1 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:10:17.384561 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7bbc22c8-9270-4b1a-92d5-42a822cb3bcd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments/987bbe46-5a54-4f2e-b147-b60dc3666adb" status: 202 len: 0 microversion: 2.1 time: 0.269315 Aug 05 20:10:17.385156 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 347/699] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:10:17 2022] DELETE /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments/987bbe46-5a54-4f2e-b147-b60dc3666adb => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:10:17.393742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c06ee156-a123-4d52-a6f9-1e860e9a4feb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:17.395963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c06ee156-a123-4d52-a6f9-1e860e9a4feb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:17.408988 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c06ee156-a123-4d52-a6f9-1e860e9a4feb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.409738 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c06ee156-a123-4d52-a6f9-1e860e9a4feb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.410190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c06ee156-a123-4d52-a6f9-1e860e9a4feb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.410907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c06ee156-a123-4d52-a6f9-1e860e9a4feb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.411370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c06ee156-a123-4d52-a6f9-1e860e9a4feb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.411826 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c06ee156-a123-4d52-a6f9-1e860e9a4feb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.459670 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c06ee156-a123-4d52-a6f9-1e860e9a4feb tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069660 Aug 05 20:10:17.464167 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 353/700] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:10:17 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:17.673491 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:17.674604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:17.681536 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.682428 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.683105 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.684714 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.685413 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.686067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.908584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:17.909469 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:17.916859 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.917382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.918173 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.918732 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.919484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.920337 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:18.064046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:18.072965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0ba16ff9-9a75-4d96-8ce2-fc0d2c1ba5bd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1724 microversion: 2.1 time: 0.403658 Aug 05 20:10:18.074476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:18.091806 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 348/701] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:17 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:18.092182 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:18.092182 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:18.092182 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-89bdc4ce-2720-4a23-874d-5ccd1e8a8c24 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.183711 Aug 05 20:10:18.097664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 354/702] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:17 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:18.473084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-abe78b8b-4b3d-446a-a508-5b65844fc4f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:18.476070 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-abe78b8b-4b3d-446a-a508-5b65844fc4f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:18.484980 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abe78b8b-4b3d-446a-a508-5b65844fc4f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:18.485668 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abe78b8b-4b3d-446a-a508-5b65844fc4f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:18.486272 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abe78b8b-4b3d-446a-a508-5b65844fc4f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:18.487135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abe78b8b-4b3d-446a-a508-5b65844fc4f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:18.487616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abe78b8b-4b3d-446a-a508-5b65844fc4f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:18.488148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abe78b8b-4b3d-446a-a508-5b65844fc4f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:18.492320 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:18.523615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-abe78b8b-4b3d-446a-a508-5b65844fc4f5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055387 Aug 05 20:10:18.524729 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 349/703] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:10:18 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:19.102196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:19.102817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:19.112108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:19.112749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:19.113421 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:19.120602 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:19.121308 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:19.122362 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:19.123127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:19.123254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:19.123974 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:19.135104 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:19.136442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:19.149001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:19.149507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:19.150206 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:19.321261 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:19.331296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4676185d-b941-4a07-988d-6689fc402615 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1724 microversion: 2.1 time: 0.232684 Aug 05 20:10:19.348871 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 355/704] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:19 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:19.458435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:19.468849 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:19.470820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:19.472056 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0703cd70-328b-46bf-b813-842835090b8f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.363976 Aug 05 20:10:19.472624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 350/705] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:19 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:19.537859 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-860ad47b-e891-41b2-b755-6f94e826002c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:19.541731 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-860ad47b-e891-41b2-b755-6f94e826002c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:19.549245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-860ad47b-e891-41b2-b755-6f94e826002c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:19.550297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-860ad47b-e891-41b2-b755-6f94e826002c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:19.550942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-860ad47b-e891-41b2-b755-6f94e826002c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:19.552627 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-860ad47b-e891-41b2-b755-6f94e826002c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:19.554377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-860ad47b-e891-41b2-b755-6f94e826002c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:19.555600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-860ad47b-e891-41b2-b755-6f94e826002c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:19.624179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-860ad47b-e891-41b2-b755-6f94e826002c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090373 Aug 05 20:10:19.626103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 356/706] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:10:19 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:20.356630 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:20.358499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:20.372565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.373298 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.374905 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.374905 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.374905 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.375182 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.497137 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:20.497759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:20.506465 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.506999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.508504 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.509254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.509985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.510691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.559466 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:20.751880 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:20.773700 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f52f5ac2-faff-4308-9ef4-52cbb33d38f8 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1730 microversion: 2.1 time: 0.417275 Aug 05 20:10:20.776999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 351/707] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:20 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1730 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:20.799825 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fdd4253e-85fd-4913-8074-b8a828e27f3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:20.809616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fdd4253e-85fd-4913-8074-b8a828e27f3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:20.818340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdd4253e-85fd-4913-8074-b8a828e27f3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.819451 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdd4253e-85fd-4913-8074-b8a828e27f3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.820212 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdd4253e-85fd-4913-8074-b8a828e27f3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.821257 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdd4253e-85fd-4913-8074-b8a828e27f3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.822430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdd4253e-85fd-4913-8074-b8a828e27f3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.823090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdd4253e-85fd-4913-8074-b8a828e27f3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.864336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:20.875443 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:20.877119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:20.879061 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ddcfd198-a4c0-4146-9308-e300efc38031 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.386419 Aug 05 20:10:20.879818 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 357/708] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:20 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:20.884981 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d6c2702e-e40d-4e1a-9b0d-a437a8e94690 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:20.885703 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d6c2702e-e40d-4e1a-9b0d-a437a8e94690 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:20.892291 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6c2702e-e40d-4e1a-9b0d-a437a8e94690 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.893046 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6c2702e-e40d-4e1a-9b0d-a437a8e94690 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.894126 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6c2702e-e40d-4e1a-9b0d-a437a8e94690 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.896331 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6c2702e-e40d-4e1a-9b0d-a437a8e94690 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.897123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6c2702e-e40d-4e1a-9b0d-a437a8e94690 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.897889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6c2702e-e40d-4e1a-9b0d-a437a8e94690 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.906306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fdd4253e-85fd-4913-8074-b8a828e27f3b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124520 Aug 05 20:10:20.906905 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 352/709] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:10:20 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:10:21.000998 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:21.001626 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:21.008419 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:21.008908 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:21.009343 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:21.010041 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:21.010490 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:21.010912 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:21.025570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d6c2702e-e40d-4e1a-9b0d-a437a8e94690 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144419 Aug 05 20:10:21.026378 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 358/710] 10.222.0.95 () {58 vars in 1275 bytes} [Fri Aug 5 20:10:20 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:21.048121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:10:21.180477 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0e8f9c97-f7bc-42f3-a93c-8896e092cbc1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 204 len: 0 microversion: 2.1 time: 0.183710 Aug 05 20:10:21.184206 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 353/711] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:10:20 2022] DELETE /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:10:21.193159 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:21.193775 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:21.201650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:21.202145 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:21.205132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:21.208706 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:21.209394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:21.209864 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:21.494243 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:21.504072 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d9f7746e-7d8e-4c75-bc57-48db295ff069 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1682 microversion: 2.1 time: 0.315016 Aug 05 20:10:21.506566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 359/712] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:21 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1682 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:21.905297 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:21.905998 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:21.925390 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:21.926237 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:21.926850 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:21.927729 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:21.928366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:21.928950 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:22.148086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:22.157565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:22.159087 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:22.160384 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-629721fa-d4d0-4c5a-ab2d-28547b41d5b2 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.261484 Aug 05 20:10:22.161512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 354/713] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:21 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:22.344042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-989588c6-68ee-4859-829b-1adade6a4d7a req-0b6a1ed5-83a3-4606-872b-4b346827c323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855b7a0d-cc32-490d-90c5-abb6c7b3a67b", "tag": "91cdb80d-7a07-4414-bbf0-8444ba9df127"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:22.367277 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-989588c6-68ee-4859-829b-1adade6a4d7a req-0b6a1ed5-83a3-4606-872b-4b346827c323 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:22.368196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-989588c6-68ee-4859-829b-1adade6a4d7a req-0b6a1ed5-83a3-4606-872b-4b346827c323 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:22.368783 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-989588c6-68ee-4859-829b-1adade6a4d7a req-0b6a1ed5-83a3-4606-872b-4b346827c323 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:22.393825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-989588c6-68ee-4859-829b-1adade6a4d7a req-0b6a1ed5-83a3-4606-872b-4b346827c323 service nova] Creating event network-changed:91cdb80d-7a07-4414-bbf0-8444ba9df127 for instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b on hv-cinder-85221 Aug 05 20:10:22.399896 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-989588c6-68ee-4859-829b-1adade6a4d7a req-0b6a1ed5-83a3-4606-872b-4b346827c323 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060075 Aug 05 20:10:22.401066 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 360/714] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:22.525882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:22.526537 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:22.533675 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:22.534363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:22.534990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:22.535885 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:22.536504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:22.537309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:22.723427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:22.733360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c3fb6b01-b68b-4dff-973a-6003b34c2d58 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1682 microversion: 2.1 time: 0.211160 Aug 05 20:10:22.734141 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 355/715] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:22 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:23.186792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:23.187839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:23.207117 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:23.207878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:23.210255 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:23.212448 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:23.215334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:23.220280 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:23.603681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:23.616751 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:23.618215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:23.619466 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c364fe96-2b24-44df-ad37-5cc191b5a1b5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.438994 Aug 05 20:10:23.620383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 361/716] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:23 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:23.756422 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:23.757069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:23.772192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:23.773034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:23.773748 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:23.775289 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:23.778774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:23.779420 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:23.977613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:23.987356 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ede9e0ff-b195-438e-a388-2a7f66d04d45 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1682 microversion: 2.1 time: 0.235069 Aug 05 20:10:23.989481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 356/717] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:23 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:24.436829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-483b54e1-98e7-4a42-9d41-614a19b92333 req-06efb9ce-ea11-4fad-8775-c8b746be2dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855b7a0d-cc32-490d-90c5-abb6c7b3a67b", "tag": "91cdb80d-7a07-4414-bbf0-8444ba9df127"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:24.447677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-483b54e1-98e7-4a42-9d41-614a19b92333 req-06efb9ce-ea11-4fad-8775-c8b746be2dc6 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:24.448531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-483b54e1-98e7-4a42-9d41-614a19b92333 req-06efb9ce-ea11-4fad-8775-c8b746be2dc6 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:24.449210 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-483b54e1-98e7-4a42-9d41-614a19b92333 req-06efb9ce-ea11-4fad-8775-c8b746be2dc6 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:24.468107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-483b54e1-98e7-4a42-9d41-614a19b92333 req-06efb9ce-ea11-4fad-8775-c8b746be2dc6 service nova] Creating event network-changed:91cdb80d-7a07-4414-bbf0-8444ba9df127 for instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b on hv-cinder-85221 Aug 05 20:10:24.476347 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-483b54e1-98e7-4a42-9d41-614a19b92333 req-06efb9ce-ea11-4fad-8775-c8b746be2dc6 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043849 Aug 05 20:10:24.477338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 362/718] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:10:24.647125 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:24.651147 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:24.665292 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:24.666072 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:24.666743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:24.668272 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:24.669433 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:24.670061 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:24.958373 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:24.969396 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:24.971272 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:24.972660 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-418e4e7d-dab3-4081-be2a-c9c875fea083 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1744 microversion: 2.20 time: 0.329446 Aug 05 20:10:24.987855 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 357/719] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:24 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1744 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:25.016745 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:25.017755 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:25.025998 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:25.026762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:25.028141 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:25.029352 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:25.029988 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:25.030584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:25.179974 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:25.188384 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b26514e0-41e5-4cea-895e-6de46710bf4b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1614 microversion: 2.1 time: 0.177646 Aug 05 20:10:25.202990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 363/720] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:25 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1614 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:26.006524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:26.008020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:26.018179 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:26.019191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:26.019868 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:26.020812 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:26.021505 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:26.022148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:26.210256 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:26.211242 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:26.236116 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:26.236479 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:26.236926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:26.237670 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:26.238132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:26.238561 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:26.259948 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:26.273662 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:26.275842 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:26.279220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9b78fb59-0df2-40eb-8154-ed486e558de4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.281183 Aug 05 20:10:26.280120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 358/721] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:25 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:26.388615 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:26.390372 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:26.392569 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:26.394866 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'fault' on Instance uuid ad207769-9bf5-4536-aa34-9551111c85e1 {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:10:26.522095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:26.531318 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-785df566-8da0-474f-ad18-d343af71e002 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 200 len: 1330 microversion: 2.1 time: 0.325679 Aug 05 20:10:26.531956 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 364/722] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:26 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 1330 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:26.745335 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-2b64d302-3253-450d-aee5-23a1279b0619 req-bf1a7c45-bb2d-4f6d-b442-de13a5c6ad6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad207769-9bf5-4536-aa34-9551111c85e1", "name": "network-vif-deleted", "tag": "680925df-cba7-4d99-b3aa-9bbe2b6329d9"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:26.763152 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2b64d302-3253-450d-aee5-23a1279b0619 req-bf1a7c45-bb2d-4f6d-b442-de13a5c6ad6f service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:26.765599 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2b64d302-3253-450d-aee5-23a1279b0619 req-bf1a7c45-bb2d-4f6d-b442-de13a5c6ad6f service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:26.766328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-2b64d302-3253-450d-aee5-23a1279b0619 req-bf1a7c45-bb2d-4f6d-b442-de13a5c6ad6f service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:26.793728 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-2b64d302-3253-450d-aee5-23a1279b0619 req-bf1a7c45-bb2d-4f6d-b442-de13a5c6ad6f service nova] Creating event network-vif-deleted:680925df-cba7-4d99-b3aa-9bbe2b6329d9 for instance ad207769-9bf5-4536-aa34-9551111c85e1 on hv-cinder-85221 Aug 05 20:10:26.808848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-2b64d302-3253-450d-aee5-23a1279b0619 req-bf1a7c45-bb2d-4f6d-b442-de13a5c6ad6f service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066758 Aug 05 20:10:26.813816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 359/723] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:27.305791 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:27.306616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:27.325086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:27.328021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:27.329916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:27.330897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:27.334148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:27.334961 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:27.385288 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-8edd3b22-c1da-4488-a169-9448b38a5d65 req-457d433e-237b-4596-8f3a-ae357c32ad65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9126b58-ee6c-4974-ba02-f2d0384bbb90", "name": "network-vif-plugged", "status": "completed", "tag": "7ee1d147-d81b-4d46-a28d-f1a0289d9691"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:27.413422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-8edd3b22-c1da-4488-a169-9448b38a5d65 req-457d433e-237b-4596-8f3a-ae357c32ad65 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:27.421295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-8edd3b22-c1da-4488-a169-9448b38a5d65 req-457d433e-237b-4596-8f3a-ae357c32ad65 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:27.422255 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-8edd3b22-c1da-4488-a169-9448b38a5d65 req-457d433e-237b-4596-8f3a-ae357c32ad65 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:27.461214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-8edd3b22-c1da-4488-a169-9448b38a5d65 req-457d433e-237b-4596-8f3a-ae357c32ad65 service nova] Creating event network-vif-plugged:7ee1d147-d81b-4d46-a28d-f1a0289d9691 for instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 on hv-cinder-85221 Aug 05 20:10:27.476843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-8edd3b22-c1da-4488-a169-9448b38a5d65 req-457d433e-237b-4596-8f3a-ae357c32ad65 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.432899 Aug 05 20:10:27.477822 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 365/724] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:27.554761 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:27.555686 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:27.576556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:27.577463 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:27.578134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:27.579401 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:27.585712 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:27.586511 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:27.627758 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 HTTP/1.1 Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:10:27.636394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:10:27.638002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'ad207769-9bf5-4536-aa34-9551111c85e1'} Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:10:27.638865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:10:27.640984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:27.642782 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:10:27.645414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e7413d47-73ae-41f8-8bd4-0c1ae0992bb9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 404 len: 111 microversion: 2.1 time: 0.095170 Aug 05 20:10:27.652919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 366/725] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:27 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:10:27.663628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7da0f1aa-05e4-4ac7-8aea-f76c88b73aab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '.version_select at 0x7f5691e28160>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:27.750760 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:27.767000 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:27.769309 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7da0f1aa-05e4-4ac7-8aea-f76c88b73aab tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-969856629" status: 202 len: 0 microversion: 2.1 time: 0.115026 Aug 05 20:10:27.771476 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:27.773967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-df296669-6337-4197-a4b6-b085da88de35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.473214 Aug 05 20:10:27.776916 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 367/726] 10.222.0.95 () {58 vars in 1218 bytes} [Fri Aug 5 20:10:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-969856629 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:10:27.779293 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 360/727] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:27 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:28.809580 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:28.810915 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:28.821953 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:28.822996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:28.824235 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:28.825278 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:28.825905 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:28.826685 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:29.253286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5a3625af-75bc-46f9-93d0-1fdf2a18305c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: .version_select at 0x7f5691c743a0>, body: {"keypair": {"name": "tempest-keypair-561030056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzjGgG3+0LrD775x9sVB7GmW9cpbCHjEpsc1WRrI/DCXJzgKSJH91li/1ZXDbl3rjJORVHr8y9I6JlrnkG+Jbirqhn2Vg/juIDwG+VkljLR5jbUJ4ZVjGgVgMQd0ygdhQ=="}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:29.270653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:29.280122 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:29.281642 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:29.282822 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-32b8fca1-0723-48d9-bc4d-46d8e25acf5e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.481095 Aug 05 20:10:29.283596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 368/728] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:28 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:29.286327 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-5a3625af-75bc-46f9-93d0-1fdf2a18305c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for project 43323ff64b8843639e0428c69d5c71c1. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:10:29.301480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-5a3625af-75bc-46f9-93d0-1fdf2a18305c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for user 67e79817ed9e40728f92a22053a24118 and project 43323ff64b8843639e0428c69d5c71c1. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:10:29.367840 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5a3625af-75bc-46f9-93d0-1fdf2a18305c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118564 Aug 05 20:10:29.369064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 361/729] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:10:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:30.306334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:30.307608 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:30.326808 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:30.327565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:30.328193 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:30.329095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:30.329712 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:30.330295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:30.636735 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:30.660672 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:30.663464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:30.676918 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7cd1b655-6ef8-431a-8778-d8debd9e338c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.366420 Aug 05 20:10:30.677721 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 369/730] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:30 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:30.846339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:30.847689 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:30.868820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:30.869731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:30.870476 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:30.872119 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:30.875454 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:30.876357 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:30.935552 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lazy-loading 'flavor' on Instance uuid e6e532dd-0c95-4d65-9f31-a698bdfdf52f {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:10:31.085766 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e7f2a2b6-8aa4-43e7-a0e2-5e83609e50d8 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "POST /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f/action" status: 202 len: 0 microversion: 2.1 time: 0.242781 Aug 05 20:10:31.101906 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:31.105933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:31.113220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 362/731] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:10:30 2022] POST /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:10:31.125974 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:31.126612 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:31.127156 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:31.132482 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:31.133458 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:31.133946 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:31.350000 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:31.359646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-aacf5178-05de-4c34-9aa9-d438a0d12452 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.268165 Aug 05 20:10:31.376491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 370/732] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:31 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:31.706125 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:31.707006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:31.719991 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:31.720883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:31.721556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:31.722483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:31.723169 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:31.723835 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:31.899877 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:31.904593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:31.913374 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:31.923149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:31.924933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fdcb75f4-da20-41cf-94cd-de945178379d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.223335 Aug 05 20:10:31.926037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 363/733] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:31 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:31.969444 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1158587697", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e6eb1b0-c7d1-48fb-bae8-24a190109c29"}], "security_groups": [{"name": "tempest-securitygroup--2000899137"}], "key_name": "tempest-keypair-561030056", "user_data": "}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:32.385185 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:32.390127 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:32.407910 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:32.408420 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:32.408872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:32.409600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:32.410058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:32.410485 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:32.706359 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:32.715934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-163d65d4-59b9-43e4-b88a-6bdb965a8818 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.336824 Aug 05 20:10:32.716956 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 364/734] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:32 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:32.953875 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:32.955357 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:32.962801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:32.963699 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:32.964887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:32.965980 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:32.966659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:32.967317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:33.207897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:33.232271 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:33.240773 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:33.242220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-66e3b8b5-659d-4844-864a-13717d8234d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.292362 Aug 05 20:10:33.259814 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 365/735] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:32 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:33.766542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:33.766542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:33.780507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:33.782410 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:33.785766 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:33.791867 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:33.791867 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:33.791867 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:34.085785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:34.098029 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b24793bf-f7ae-4ecf-8691-dbf1f62f4368 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.347193 Aug 05 20:10:34.115724 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 366/736] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:33 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:34.277900 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:34.278984 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:34.305337 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:34.306253 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:34.311795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:34.313196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:34.313999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:34.314670 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:34.536689 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:34.571506 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:34.571506 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:34.571506 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f5b1bc71-bd6f-4532-b4d7-95fa04b30cc6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.297528 Aug 05 20:10:34.571985 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 367/737] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:34 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:35.122966 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:35.124761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:35.131939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:35.132875 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:35.134622 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:35.135606 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:35.136387 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:35.137246 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:35.325461 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:35.337259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f3334c11-2e08-409c-8296-6438571575a0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.218589 Aug 05 20:10:35.351328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 368/738] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:35 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:35.419597 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-caf05712-cb87-49c0-a2eb-b79ae540e3dd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Action: 'create', calling method: .version_select at 0x7f5691e64af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1338265923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAAS4h4uo6r6m5o8JV/jtjUMDoFV9jhoAsBqfZ1WcPwd7APfmHwsz8U5LsdZ3DL8MdqCv1VwyDA8slL1a74BumVeHx2sS2esS3eBc/lOwaHHF7vmI/ZZeVLXyX5BOLe6g=="}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:35.466754 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-caf05712-cb87-49c0-a2eb-b79ae540e3dd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Getting quotas for project c8dacae2d58843f2b1b8b532759b83ee. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:10:35.475110 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-caf05712-cb87-49c0-a2eb-b79ae540e3dd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Getting quotas for user 44c083ae1c5a4444a55ecb26cfdd58ca and project c8dacae2d58843f2b1b8b532759b83ee. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:10:35.506256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-caf05712-cb87-49c0-a2eb-b79ae540e3dd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.091112 Aug 05 20:10:35.518395 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 369/739] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:10:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:35.558073 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] validate_networks() for [('0e6eb1b0-c7d1-48fb-bae8-24a190109c29', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:10:35.585339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1443158974", "imageRef": "a5a5fb22-ea17-4802-8f9e-aaf8129e3a4d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1338265923", "networks": [{"uuid": "a907209b-bcfd-45d1-9494-edbbeefc9415"}]}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:35.648801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.network.neutron [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] validate_networks() for [('a907209b-bcfd-45d1-9494-edbbeefc9415', None, None, None, None, None)] {{(pid=118175) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:10:36.201253 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:10:36.201621 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:10:36.202378 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:10:36.202983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:10:36.203618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:10:36.216614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.217397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.217842 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:36.218776 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.219421 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.220410 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:36.243017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for project 43323ff64b8843639e0428c69d5c71c1. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:10:36.248405 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Getting quotas for user 67e79817ed9e40728f92a22053a24118 and project 43323ff64b8843639e0428c69d5c71c1. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:10:36.260142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:10:36.263961 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:10:36.290130 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Flavor limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:10:36.290872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Image limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:10:36.291463 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Flavor pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:10:36.294257 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Image pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:10:36.298286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:10:36.310584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.311337 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.311803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:36.313427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.313427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.313871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:36.325153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-dfa9bee8-9d70-4eed-bb19-ef4656c40613 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.365104 Aug 05 20:10:36.331454 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 371/740] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:10:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 4367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:10:36.331454 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:36.331974 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:36.340557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.341373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.342018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:36.343077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.343729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.344375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:36.368304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Getting quotas for project c8dacae2d58843f2b1b8b532759b83ee. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:10:36.379000 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:36.382823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Getting quotas for user 44c083ae1c5a4444a55ecb26cfdd58ca and project c8dacae2d58843f2b1b8b532759b83ee. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:10:36.424713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Going to run 1 instances... {{(pid=118175) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:10:36.431835 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5a5fb22-ea17-4802-8f9e-aaf8129e3a4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118175) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:10:36.536536 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bb2e4884-b4a7-40e6-85b6-f0651c875e53 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955657 Aug 05 20:10:36.537640 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 370/741] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:10:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 20:10:36.547913 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7eb9d5a9-5ba6-4e52-959b-da05c90aaff2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:36.552215 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7eb9d5a9-5ba6-4e52-959b-da05c90aaff2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:36.608672 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:36.620834 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:36.622486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:36.623978 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cb4130e0-8bd5-410f-85bd-2a40f86fa066 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.296621 Aug 05 20:10:36.625146 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 372/742] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:36 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:36.631032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:36.631917 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:36.638790 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.639640 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.640315 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:36.641262 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.642278 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.642916 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:36.699672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7eb9d5a9-5ba6-4e52-959b-da05c90aaff2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:36.708200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7eb9d5a9-5ba6-4e52-959b-da05c90aaff2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1241 microversion: 2.1 time: 0.168342 Aug 05 20:10:36.710660 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 371/743] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:36 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1241 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:36.718926 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2af5511c-d020-4515-8d0e-9f04d5669fdc tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:36.723939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-2af5511c-d020-4515-8d0e-9f04d5669fdc tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:36.837331 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-2af5511c-d020-4515-8d0e-9f04d5669fdc tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:36.847363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-2af5511c-d020-4515-8d0e-9f04d5669fdc tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1259 microversion: 2.1 time: 0.134186 Aug 05 20:10:36.847760 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 372/744] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:36 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:36.857071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:36.871697 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b2752c1a-e1c3-4db1-86fe-c417366cec2f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.245270 Aug 05 20:10:36.882923 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 373/745] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:36 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:37.655092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:37.655622 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:37.665432 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:37.666009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:37.666493 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:37.671602 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:37.672913 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:37.673395 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:37.729175 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:37.730131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:37.738125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:37.738618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:37.739062 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:37.739771 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:37.740251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:37.740881 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:37.853817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:37.863452 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fc3059c4-5534-4032-bf9e-c28d761c2f8f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1293 microversion: 2.1 time: 0.137962 Aug 05 20:10:37.864645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 374/746] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:37 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1293 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:37.871442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:37.872338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:37.879457 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:37.880226 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:37.880845 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:37.881711 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:37.882317 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:37.882893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:37.893552 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:37.912089 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:37.915519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:37.919462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8377c68d-78df-4d2e-96a0-7f2f003ce090 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.267908 Aug 05 20:10:37.920553 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 373/747] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:37 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:37.927415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:37.929088 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:37.942381 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:37.942381 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:37.942381 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:37.944076 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:37.944725 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:37.945324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:37.958869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:37.968044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-dccb3a88-b894-4307-b69f-319bb4a29f5b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1311 microversion: 2.1 time: 0.100339 Aug 05 20:10:37.968621 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 375/748] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:37 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:38.095549 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:38.103934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8e5bbdbd-8c60-4a71-88d8-642bb7479067 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.182278 Aug 05 20:10:38.105008 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 374/749] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:37 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:38.887350 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:38.888206 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:38.901205 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:38.901708 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:38.902153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:38.902857 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:38.903496 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:38.904463 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:38.943249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:38.944748 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:38.952737 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:38.953608 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:38.954479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:38.955447 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:38.956188 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:38.958037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:39.012229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:39.022999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-07d6ac63-dda8-4ec1-a3ab-85e8db96e0b4 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1299 microversion: 2.1 time: 0.140448 Aug 05 20:10:39.023574 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 376/750] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:38 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:39.035907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:39.037003 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:39.052983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:39.053724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:39.054335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:39.055204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:39.056025 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:39.056258 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:39.130945 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:39.141988 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:39.144282 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:39.145701 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1e0f7491-4133-4cba-85cf-181c8fc9ba35 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1739 microversion: 2.20 time: 0.206521 Aug 05 20:10:39.146762 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 375/751] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:38 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:39.152321 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:39.153159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:39.160274 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:39.160974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:39.161595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:39.162517 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:39.163157 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:39.164076 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:39.170966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:39.179654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c033b95f-cd11-439a-86e4-067757ecbf8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1317 microversion: 2.1 time: 0.154938 Aug 05 20:10:39.180446 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 377/752] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:39 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:39.366944 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:39.375957 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4070d7c9-9ff1-4e9e-91d7-c4db740c3807 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.227921 Aug 05 20:10:39.378555 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 376/753] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:39 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:40.046290 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:40.054750 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:40.065259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:40.066766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.068218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.068675 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.070734 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.074498 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.076047 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.149919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:40.175273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:40.177895 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:40.191029 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.191967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.192581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.193524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.196173 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.196809 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.434695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:40.445050 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-737c4fb2-bf85-4ecc-90f2-736af26b5516 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.403848 Aug 05 20:10:40.446230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 378/754] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:40 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:40.453135 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:40.454019 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:40.464643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.465392 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.465908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.466693 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.467748 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.468381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.497836 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:40.507498 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:40.509722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:40.511275 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-505be3ea-ae55-4b37-b8f6-546f8dbebd09 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.344266 Aug 05 20:10:40.512762 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 377/755] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:40 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:40.517589 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:40.518273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:40.526732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.527306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.538042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.539088 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.539556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.540074 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.717124 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:40.725668 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-43784358-9219-4164-84a7-14a684b09c14 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.277585 Aug 05 20:10:40.726996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 379/756] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:40 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:40.781928 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:40.790195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bdf86ed9-3f96-4e7b-b2d5-6d659bf3b8cc tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.276330 Aug 05 20:10:40.791057 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 378/757] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:40 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:41.465843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:41.467111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:41.473973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.474474 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.474916 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.475617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.476098 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.476522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.535900 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:41.536630 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:41.551538 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.563171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.563679 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.564466 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.564939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.565366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.652653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:41.664227 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c7ce798b-10df-4aa1-b5cc-a38a8f9e7612 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.202272 Aug 05 20:10:41.665064 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 380/758] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:41 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:41.729002 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:41.737600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:41.739513 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:41.740937 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ce5b5f1f-9555-40a7-8134-a0d5bdf83127 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.208894 Aug 05 20:10:41.748448 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 379/759] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:41 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:41.749743 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:41.750464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:41.757040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.757852 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.758399 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.759210 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.761947 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.762655 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.817942 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:41.818823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:41.826016 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.826761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.827367 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.828482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.829107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.829691 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.938644 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:41.949898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c9dd8b65-a843-4ba4-bc93-69a218126265 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.204457 Aug 05 20:10:41.950439 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 381/760] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:41 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:41.997899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:42.005368 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0bc2633a-bb48-43f2-af80-41e945de1203 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.192771 Aug 05 20:10:42.005937 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 380/761] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:41 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:42.688593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:42.689272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:42.697124 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.698102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.698664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.699486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.700288 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.700646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.766015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:42.766796 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:42.777017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.778001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.778001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.778979 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.779500 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.780024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.906992 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:42.917193 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7302f617-f93f-4835-9366-3596f6e076a7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.232914 Aug 05 20:10:42.928370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 382/762] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:42 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:42.935622 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-28cae04c-23f9-4de1-9d5f-939153b61efc req-4cd704e4-cb7d-4337-a557-25d3f1fb813c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9126b58-ee6c-4974-ba02-f2d0384bbb90", "name": "network-vif-unplugged", "status": "completed", "tag": "7ee1d147-d81b-4d46-a28d-f1a0289d9691"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:42.946749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-28cae04c-23f9-4de1-9d5f-939153b61efc req-4cd704e4-cb7d-4337-a557-25d3f1fb813c service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.947264 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-28cae04c-23f9-4de1-9d5f-939153b61efc req-4cd704e4-cb7d-4337-a557-25d3f1fb813c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.947770 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-28cae04c-23f9-4de1-9d5f-939153b61efc req-4cd704e4-cb7d-4337-a557-25d3f1fb813c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.961718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-28cae04c-23f9-4de1-9d5f-939153b61efc req-4cd704e4-cb7d-4337-a557-25d3f1fb813c service nova] Creating event network-vif-unplugged:7ee1d147-d81b-4d46-a28d-f1a0289d9691 for instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 on hv-cinder-85221 Aug 05 20:10:42.969959 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-28cae04c-23f9-4de1-9d5f-939153b61efc req-4cd704e4-cb7d-4337-a557-25d3f1fb813c service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040095 Aug 05 20:10:42.970800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 383/763] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:42.972263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:42.975900 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:42.976735 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:42.981299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:42.982820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:42.984064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4b575aae-cd94-426c-abc9-3d6a52c4ec6f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.221962 Aug 05 20:10:42.984194 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.984639 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 381/764] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:42 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:42.984766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.985244 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.986095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.986624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.987147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:43.028779 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:43.029741 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:43.036858 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:43.037719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:43.038378 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:43.039565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:43.040319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:43.041014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:43.161492 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:43.172301 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-044738e9-6cc1-436d-b4a5-4542663b7acd tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.200305 Aug 05 20:10:43.173158 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 384/765] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:42 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:43.203360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:43.211120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fb2e3229-ff2b-4230-b6e3-4293563b0d93 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.186587 Aug 05 20:10:43.211807 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 382/766] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:43 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:43.941013 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:43.941953 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:43.949820 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:43.950459 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:43.951014 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:43.952042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:43.952754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:43.953287 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.006616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:44.007218 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:44.033708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.034209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.034690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.035369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.036238 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.036348 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.102029 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:44.110734 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-adad7558-afee-4dff-b74d-50c00ab291e9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.173626 Aug 05 20:10:44.111671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 385/767] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:43 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:44.185669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:44.193176 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:44.194026 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:44.194485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:44.195535 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:44.196713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8196de56-067a-4995-a964-952e1cfd1cac tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.194000 Aug 05 20:10:44.197580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 383/768] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:44 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:44.203012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.203502 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.203965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.204698 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.205156 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.205749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.233466 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:44.234403 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:44.241214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.241720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.242360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.243091 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.243545 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.244389 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.250099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:44.390609 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:44.399373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-12f1131e-7cce-443f-8534-e33211f670d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.210047 Aug 05 20:10:44.399998 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 386/769] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:44 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:44.459962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:44.469372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6f0e17a6-f018-4786-bc37-04d8dc1119ff tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.240261 Aug 05 20:10:44.473272 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 384/770] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:44 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:45.132784 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:45.133727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:45.141248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.141917 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.142418 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.143395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.144023 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.144597 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.219910 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:45.220528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:45.228757 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.231281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.231281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.231852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.232348 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.232790 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.308223 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:45.317683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-da86cc69-1afc-497a-a3b5-03bf5958dc7f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.188856 Aug 05 20:10:45.319084 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 387/771] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:45 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:45.381111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:45.389356 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:45.390915 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:45.392133 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ad427fcb-7948-4d30-bc18-76014b64ba40 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.176210 Aug 05 20:10:45.392728 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 385/772] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:45 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:45.435046 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:45.435683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:45.442023 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.442512 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.442946 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.443643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.444183 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.444605 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.492716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:45.493369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:45.500239 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.501256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.501697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.502545 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.503000 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.503486 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.616629 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:45.626933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9c7563d7-8f89-46be-841c-31ad3ec95d1c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.210228 Aug 05 20:10:45.628127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 388/773] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:45 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:45.683852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:45.691951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9d4305e3-1ccc-46c6-b517-0fa50c7ed57e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.203768 Aug 05 20:10:45.692535 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 386/774] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:45 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:46.339056 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:46.339999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:46.342319 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:46.342977 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=6 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:46.348757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.349208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.349648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.350387 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.350813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.351242 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.415191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:46.415882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:46.421059 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:46.437669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.438162 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.438604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.439485 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.447954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.448438 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.529626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:46.544508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b4257e1f-2e40-463c-9235-a5be3fb2b0fc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.209796 Aug 05 20:10:46.548846 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 389/775] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:46 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:46.606096 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:46.614259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:46.615757 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:46.616932 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f6ffe33f-b4dd-47e3-8ac8-f8cb5af5f30b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.206301 Aug 05 20:10:46.617702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 387/776] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:46 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:46.648763 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:46.649370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:46.655557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.656074 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.656514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.657208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.657691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.658116 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.714708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:46.715822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:46.721995 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.722489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.722920 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.723695 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.724179 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.724601 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.824719 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:46.832146 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3bd47c3b-e697-4e45-a94a-7cf8d223b60e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.187302 Aug 05 20:10:46.832714 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 390/777] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:46 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:46.846442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=18 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:46.872507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:46.880969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fc46db00-14f0-4bfe-bd9b-bec2ea299547 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.170361 Aug 05 20:10:46.881542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 388/778] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:46 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:47.569643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:47.570363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:47.580742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.581233 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.581670 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.582370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.582821 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.583245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.640529 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:47.641239 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:47.647732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.648372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.648820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.649525 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.649989 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.650418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.720386 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:47.727673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-437b2c76-3e1b-4abc-8638-08f546d7a4ee tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.162014 Aug 05 20:10:47.728263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 391/779] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:47 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:47.785380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:47.794114 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:47.795620 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:47.796967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e4284ee8-15e7-4afd-ab1b-6a6fa282dbe3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.160356 Aug 05 20:10:47.797530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 389/780] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:47 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:47.853153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:47.853788 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:47.860579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.861062 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.861494 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.862176 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.862625 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.863040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.902996 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:47.903594 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:47.909532 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.910015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.910449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.911139 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.911594 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.912044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.999135 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:48.007728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-48817182-a8d0-4658-8b8b-337a9b2c505a tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.158264 Aug 05 20:10:48.008470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 392/781] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:47 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:48.052560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:48.060340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-91499ea6-bdcb-424d-b7b9-9d61e43a3c4d tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.161763 Aug 05 20:10:48.060904 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 390/782] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:47 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:48.114284 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:48.114781 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:48.120835 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.121311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.121744 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.122426 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.122875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.123296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.148206 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Going to try to terminate instance {{(pid=118174) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:10:48.224343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c8278f5d-1024-4807-97a0-ed537a83b34c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "DELETE /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 204 len: 0 microversion: 2.1 time: 0.113574 Aug 05 20:10:48.224928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 393/783] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:10:48 2022] DELETE /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:10:48.233221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:48.233821 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:48.239813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.240301 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.240732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.241410 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.241860 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.242279 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.379197 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:48.387971 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-22a5bc82-62a6-4972-8a31-5c609c720b01 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1578 microversion: 2.1 time: 0.158469 Aug 05 20:10:48.388563 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 391/784] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:48 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:48.750282 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:48.751574 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:48.758170 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.758786 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.759283 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.760749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.761245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.761671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.765989 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:48.818531 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:48.819232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:48.826504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.827005 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.827512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.828310 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.828836 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.829349 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.963554 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:48.972668 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:48.976551 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:48.976551 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-96d74cd0-5a05-4182-80d2-b8b3db4d50f8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.160837 Aug 05 20:10:48.976551 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 392/785] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:48 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:49.028998 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:49.029746 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:49.035754 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.036351 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.036792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.037488 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.037946 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.038375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.054074 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:49.062495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ff97bf53-2f6e-49cc-bcbc-90acc623179f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.316369 Aug 05 20:10:49.063317 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 394/786] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:48 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:49.081457 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:49.082319 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:49.089926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.090445 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.090876 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.091589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.092245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.092839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.191625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:49.199316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-50f4e1c6-56df-4a4f-a279-aaeaee940183 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.174139 Aug 05 20:10:49.200153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 393/787] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:49 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:49.410457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:49.411153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:49.418357 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.419072 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.419575 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.420375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.420898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.421399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.462799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:49.472382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a35ac9ee-05ee-448a-ba70-1e691f850f26 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.394687 Aug 05 20:10:49.473150 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 395/788] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:49 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:49.591270 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:49.605430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9e7560a1-646e-494a-91a0-fdedf0db6cd9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1578 microversion: 2.1 time: 0.196219 Aug 05 20:10:49.624687 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 394/789] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:49 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1578 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:49.733891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-434716a7-63c8-4234-9709-21cc711a7aa0 req-8489066a-8c01-48cd-9340-d50e38b19e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94cc1d6-32e5-4c24-8e26-e811d5a25389", "tag": "ccf2670a-c2a3-4a62-ad5a-290565f526fe"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:49.744231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-434716a7-63c8-4234-9709-21cc711a7aa0 req-8489066a-8c01-48cd-9340-d50e38b19e75 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.745393 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-434716a7-63c8-4234-9709-21cc711a7aa0 req-8489066a-8c01-48cd-9340-d50e38b19e75 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.745887 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-434716a7-63c8-4234-9709-21cc711a7aa0 req-8489066a-8c01-48cd-9340-d50e38b19e75 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.758119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-434716a7-63c8-4234-9709-21cc711a7aa0 req-8489066a-8c01-48cd-9340-d50e38b19e75 service nova] Creating event network-changed:ccf2670a-c2a3-4a62-ad5a-290565f526fe for instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 on hv-cinder-85221 Aug 05 20:10:49.764524 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-434716a7-63c8-4234-9709-21cc711a7aa0 req-8489066a-8c01-48cd-9340-d50e38b19e75 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035021 Aug 05 20:10:49.765240 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 396/790] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:50.005001 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:50.006248 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:50.014709 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.015205 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.015647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.016413 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.016866 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.017300 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.084236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:50.085242 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:50.092214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.092838 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.093538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.094507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.095184 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.095684 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.177309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:50.185651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:50.187245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:50.188627 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-abb84e19-f8cc-4e22-8566-4600c77832cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.187531 Aug 05 20:10:50.189268 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 395/791] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:49 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:50.220985 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:50.221620 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:50.227713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.228229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.228669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.229962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.230421 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.231377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.263658 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:50.271365 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a8ffb4ca-1e69-4bce-a65a-f08d8b77facd tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.191357 Aug 05 20:10:50.272540 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 397/792] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:50 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:50.503865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:50.507535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:50.519841 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.521442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.522056 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.523481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.524134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.525098 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.585441 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:50.594091 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0fc32277-537c-4eff-a333-4375e4349b47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.376840 Aug 05 20:10:50.594689 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 396/793] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:50 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:50.628424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:50.629052 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:50.636268 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.636769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.637229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.638091 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:50.638727 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:50.639164 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.016200 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:51.025024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0cde7beb-967c-4fb6-ad0c-fc32b7afbc70 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.528795 Aug 05 20:10:51.025904 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 398/794] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:50 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:51.207128 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:51.216781 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-28ac539d-98f1-4b33-ae16-8772c342f3f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1578 microversion: 2.1 time: 0.595591 Aug 05 20:10:51.217282 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:51.218145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 397/795] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:50 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1578 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:51.218508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:51.233401 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:51.233401 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:51.233690 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.236487 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:51.237177 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:51.237776 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.295511 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:51.296595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:51.303797 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:51.304450 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:51.305016 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.306318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:51.307198 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:51.308499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.488761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:51.497221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-023c2789-8c7a-4668-bbca-d7d29ec9d225 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.206900 Aug 05 20:10:51.497800 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 398/796] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:51 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:51.616851 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:51.617461 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:51.626178 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:51.626854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:51.627383 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.628270 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:51.628735 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:51.629165 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.684698 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:51.694075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:51.694989 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:51.696396 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4a7bf421-440b-458f-abc1-6c3402fbc510 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.486180 Aug 05 20:10:51.697152 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 399/797] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:51 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:51.768069 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:51.776885 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-339be328-75f4-474e-a2cd-0e589d646776 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.162868 Aug 05 20:10:51.777902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 399/798] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:51 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:51.787763 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-15a09657-87cf-4432-b31c-b4964b69ee5c req-90ec6447-861b-449f-9a3f-70bc199e9db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101b95bd-3a7e-45bb-84b4-95f248da5670", "tag": "69b936c8-4655-45e3-8477-1b9b83278ede"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:51.799456 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-15a09657-87cf-4432-b31c-b4964b69ee5c req-90ec6447-861b-449f-9a3f-70bc199e9db2 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:51.800212 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-15a09657-87cf-4432-b31c-b4964b69ee5c req-90ec6447-861b-449f-9a3f-70bc199e9db2 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:51.800653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-15a09657-87cf-4432-b31c-b4964b69ee5c req-90ec6447-861b-449f-9a3f-70bc199e9db2 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.811148 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-15a09657-87cf-4432-b31c-b4964b69ee5c req-90ec6447-861b-449f-9a3f-70bc199e9db2 service nova] Creating event network-changed:69b936c8-4655-45e3-8477-1b9b83278ede for instance 101b95bd-3a7e-45bb-84b4-95f248da5670 on hv-cinder-85221 Aug 05 20:10:51.816136 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-15a09657-87cf-4432-b31c-b4964b69ee5c req-90ec6447-861b-449f-9a3f-70bc199e9db2 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033913 Aug 05 20:10:51.817001 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 400/799] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:52.052840 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:52.053462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:52.059897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.060394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.060841 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.061543 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.062006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.062437 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.199433 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:52.203034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:52.207897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b41d4375-2e6a-4ca5-a380-3501b4128ab9 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.158898 Aug 05 20:10:52.208521 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 400/800] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:52 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:52.241603 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:52.242304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:52.248589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.249083 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.249519 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.250249 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.250654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.251194 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.317830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:52.325976 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-dca1a1b4-55af-4d30-b713-19fc9d485d41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1510 microversion: 2.1 time: 0.088539 Aug 05 20:10:52.326829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 401/801] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:52 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:52.518153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:52.518733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:52.524797 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.525285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.525728 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.526790 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.527254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.527688 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.661276 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:52.669629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c5a8fbd4-5ad4-4ada-9739-623ce2cf4c11 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.155782 Aug 05 20:10:52.670199 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 401/802] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:52 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:52.720108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:52.720724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:52.726666 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.727150 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.727589 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.728306 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.729273 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.729702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.798293 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:52.798910 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:52.805241 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.805815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.806258 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.807670 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.808239 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.808733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.893456 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:52.911563 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:52.913062 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:52.914690 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e9416db8-8f8d-4227-8c1b-bd42e2585d4e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.198436 Aug 05 20:10:52.915356 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 402/803] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:52 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:52.966625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:52.974773 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a18e57da-f92c-42b2-b93f-7c5a44bceeb2 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.180187 Aug 05 20:10:52.975365 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 402/804] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:52 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:53.231432 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:53.232072 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:53.237975 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.238455 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.238889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.239573 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.240049 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.240470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.347024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:53.347730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:53.355630 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.356183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.356705 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.357487 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.357944 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.358393 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.376951 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:53.384556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8ed0235c-1294-4ed9-a5b8-d09939432321 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.157875 Aug 05 20:10:53.385973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 403/805] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:53 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:53.421364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:53.429232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6144c842-e422-4d5b-8b7a-965ee159095e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1225 microversion: 2.1 time: 0.085635 Aug 05 20:10:53.429424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 403/806] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:53 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:53.690737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:53.691259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:53.697205 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.698362 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.698803 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.699506 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.699984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.700411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.831734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-c2f57b66-353f-49f1-bfe2-96f0b567ad8e req-3ea99712-4829-46ee-ab42-03ef98db2b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1af2142-ec43-40b7-b612-0ba54aba802a", "name": "network-vif-deleted", "tag": "40a30526-22e8-498f-88ef-1351df155391"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:53.832749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:53.841236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-262a028d-d6df-4530-bbaa-569911dfdaca tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.154413 Aug 05 20:10:53.841710 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-c2f57b66-353f-49f1-bfe2-96f0b567ad8e req-3ea99712-4829-46ee-ab42-03ef98db2b9b service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.841847 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 404/807] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:53 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:53.842195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-c2f57b66-353f-49f1-bfe2-96f0b567ad8e req-3ea99712-4829-46ee-ab42-03ef98db2b9b service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.842650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-c2f57b66-353f-49f1-bfe2-96f0b567ad8e req-3ea99712-4829-46ee-ab42-03ef98db2b9b service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.853219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-c2f57b66-353f-49f1-bfe2-96f0b567ad8e req-3ea99712-4829-46ee-ab42-03ef98db2b9b service nova] Creating event network-vif-deleted:40a30526-22e8-498f-88ef-1351df155391 for instance e1af2142-ec43-40b7-b612-0ba54aba802a on hv-cinder-85221 Aug 05 20:10:53.858646 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-c2f57b66-353f-49f1-bfe2-96f0b567ad8e req-3ea99712-4829-46ee-ab42-03ef98db2b9b service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030697 Aug 05 20:10:53.859214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 404/808] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:10:53.938579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:53.939183 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:53.945110 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.945533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.945969 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.946653 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.947103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.947564 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.996758 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:53.997442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:54.003511 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.004026 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.004462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.005146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.005593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.006018 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.081974 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:54.090943 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:54.092504 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:54.093677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-114fb48f-935f-47a2-bef6-0be079e95fa8 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.159034 Aug 05 20:10:54.094243 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 405/809] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:53 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:54.138321 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:54.145604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d21b4a1b-2586-4cfe-a432-2b4b8fee6e21 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.153256 Aug 05 20:10:54.146170 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 405/810] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:53 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:54.407342 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:54.408054 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:54.414308 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.414791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.415227 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.416995 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.416995 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.417228 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.453865 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:54.454489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:54.462569 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.462991 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.464082 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.465003 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.465645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.466083 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.529463 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:54.537081 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-04b5a17f-9e38-4223-8325-d1ec1f64f291 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1225 microversion: 2.1 time: 0.091343 Aug 05 20:10:54.537649 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 406/811] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:54 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:54.555191 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:54.563238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f92ccbb5-a7a8-403a-89bc-22206f35fa09 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.159860 Aug 05 20:10:54.563806 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 406/812] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:54 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:54.861760 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:54.862542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:54.868469 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.868930 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.870113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.870808 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.871258 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.871684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.001547 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:55.008809 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3c3dbfbe-5267-4de1-b8ff-d58c7659b1e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.150966 Aug 05 20:10:55.009374 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 407/813] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:54 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:55.117383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:55.117910 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:55.125007 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.125496 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.125934 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.126625 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.127079 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.127504 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.167265 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:55.168005 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:55.174508 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.175008 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.175483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.176219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.176710 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.177172 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.261825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:55.269885 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:55.271611 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:55.272806 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8d8637f9-5d23-4095-8865-406350d07089 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1721 microversion: 2.20 time: 0.159623 Aug 05 20:10:55.273363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 407/814] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:55 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:55.309285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:55.316610 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-2f1547b7-ce49-453f-9c19-835aa89c8933 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.154100 Aug 05 20:10:55.317173 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 408/815] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:55 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:55.558604 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:55.559188 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:55.565087 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.565568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.566000 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.566678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.567125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.567542 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.584650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:55.585377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:55.591987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.592473 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.592915 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.593611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.594068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.594491 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.633032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:55.641393 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f362da9a-7be3-4b3e-92bc-ee43efebf393 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1225 microversion: 2.1 time: 0.087126 Aug 05 20:10:55.641980 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 408/816] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:55 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:55.727395 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:55.736750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6e096538-d6cf-44b9-a553-7c5d2e7b157b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.155917 Aug 05 20:10:55.737331 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 409/817] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:55 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:56.029877 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:56.030481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:56.036518 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.036995 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.037423 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.038102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.038813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.039232 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.267218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:56.281296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d00bd6f3-bd40-48fd-afd6-1a3435639bd8 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.255879 Aug 05 20:10:56.284085 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 409/818] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:56 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:56.297614 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:56.298231 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:56.306028 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.306702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.307146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.307960 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.308337 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.308902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.339464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:56.340299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:56.346457 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.346949 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.347389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.348355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.349029 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.349146 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.491440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:56.500101 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:56.501583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:56.502728 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-66317b67-7593-4d1a-bd73-57155c72d80b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1724 microversion: 2.20 time: 0.209292 Aug 05 20:10:56.503288 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 410/819] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:56 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:56.507403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:56.515275 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6dedd927-370b-4013-afc4-507d6d42ba2e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.181027 Aug 05 20:10:56.515794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 410/820] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:56 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:56.525129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-de699f83-881a-4cfe-90b2-bf6628f75583 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b73f29af-a46e-40f6-ae41-c1cb7345ab7f"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:56.527585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-de699f83-881a-4cfe-90b2-bf6628f75583 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:56.533473 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de699f83-881a-4cfe-90b2-bf6628f75583 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.533956 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de699f83-881a-4cfe-90b2-bf6628f75583 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.534389 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de699f83-881a-4cfe-90b2-bf6628f75583 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.535072 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de699f83-881a-4cfe-90b2-bf6628f75583 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.535522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de699f83-881a-4cfe-90b2-bf6628f75583 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.535970 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de699f83-881a-4cfe-90b2-bf6628f75583 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.663064 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:56.664732 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:56.674131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.674965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.675610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.676564 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.677210 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.678729 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.733024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.733766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.734430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.734918 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lazy-loading 'fault' on Instance uuid e1af2142-ec43-40b7-b612-0ba54aba802a {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:10:56.781984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:56.786290 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:56.792484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-340016ed-5168-4ba6-8241-487c619e2a34 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 200 len: 1230 microversion: 2.1 time: 0.133204 Aug 05 20:10:56.794726 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 411/821] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:56 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 1230 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:56.799929 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:56.800797 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:56.810334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.811126 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.811772 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.812773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.813431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.814057 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.936720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-de699f83-881a-4cfe-90b2-bf6628f75583 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.415516 Aug 05 20:10:56.938343 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 411/822] 10.222.0.95 () {62 vars in 1364 bytes} [Fri Aug 5 20:10:56 2022] POST /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/os-volume_attachments => generated 188 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:10:56.967298 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:56.998979 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f1c18581-1e6e-4b8e-8b68-3a187189ebcf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.202692 Aug 05 20:10:57.016623 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 412/823] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:56 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:57.123964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c74fe7cb-d1a1-4705-9a43-7a61e776ed67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:57.124462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c74fe7cb-d1a1-4705-9a43-7a61e776ed67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:57.131229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c74fe7cb-d1a1-4705-9a43-7a61e776ed67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.131724 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c74fe7cb-d1a1-4705-9a43-7a61e776ed67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.132230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c74fe7cb-d1a1-4705-9a43-7a61e776ed67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.133517 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c74fe7cb-d1a1-4705-9a43-7a61e776ed67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.133977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c74fe7cb-d1a1-4705-9a43-7a61e776ed67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.134396 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c74fe7cb-d1a1-4705-9a43-7a61e776ed67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.305295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:57.306274 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:57.326045 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.326544 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.326974 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.327678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.328173 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.328596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.420015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c74fe7cb-d1a1-4705-9a43-7a61e776ed67 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "DELETE /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/os-volume_attachments/b73f29af-a46e-40f6-ae41-c1cb7345ab7f" status: 202 len: 0 microversion: 2.20 time: 0.300488 Aug 05 20:10:57.424520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 412/824] 10.222.0.95 () {60 vars in 1457 bytes} [Fri Aug 5 20:10:57 2022] DELETE /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/os-volume_attachments/b73f29af-a46e-40f6-ae41-c1cb7345ab7f => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:10:57.478888 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:57.485872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:57.486755 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:57.487398 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0efd131a-ea7f-44c8-b13e-d5e5510146c9 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.185772 Aug 05 20:10:57.488409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 413/825] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:57 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:57.493858 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.495044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.496053 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.496779 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.497244 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.497679 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.501630 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:57.527681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:57.532020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118175) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:10:57.537503 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:57.538428 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:57.545669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.546747 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.547495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.548251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.548785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.549522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.605123 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0c072582-e047-4bba-b007-3e90826b9d1e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "POST /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/action" status: 202 len: 0 microversion: 2.20 time: 0.122936 Aug 05 20:10:57.608798 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 413/826] 10.222.0.95 () {62 vars in 1319 bytes} [Fri Aug 5 20:10:57 2022] POST /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:10:57.614007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:57.614618 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:57.622386 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.622881 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.623328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.624077 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.624536 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.624966 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.711437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:57.720508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-14379692-be1c-4afa-90c9-bbaa6af89721 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.187592 Aug 05 20:10:57.721415 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 414/827] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:57 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:57.814426 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:57.815189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:57.821363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.821985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.822545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.823349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.823903 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.824392 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.825563 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:57.834922 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:57.836475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:57.837683 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8c06fb2d-ce2a-479c-8354-e9539b4d6a0c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1672 microversion: 2.20 time: 0.227715 Aug 05 20:10:57.839083 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 414/828] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:57 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1672 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:57.845907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] HTTP exception thrown: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Request method failure captured: Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a HTTP/1.1 Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XhzbAOs_Rb5x47ulHugnvs82H0RFcMVuKB4COdk70vwt7b5Nn1UpOcj7xCRWmBnwY7SHIJu20lI6qxme3P6Yz5MbIvV7u8dDiuPP3nG1NRbJlUbM83RT3JCzjFZl13Rv-LOkw-1tmfa26hH_5sWlLgwIFzn82PJxc6995I0qYGgy7Q Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:10:57.847618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 6f89a5e4981e423b84d5f28b33bd9629 Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:10:57.849063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'e1af2142-ec43-40b7-b612-0ba54aba802a'} Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:10:57.849878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:10:57.851213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:10:57.852681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Returning 404 to user: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:10:57.852681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4f21f3fa-c398-4e23-a6b7-bd640c943e14 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 404 len: 111 microversion: 2.1 time: 0.038621 Aug 05 20:10:57.852681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 415/829] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:57 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:10:57.955297 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-358288378", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1260976200", "security_groups": [{"name": "tempest-secgroup-smoke-1644851318"}], "block_device_mapping_v2": [{"uuid": "2489de51-75a0-432d-955e-71c7fafad18f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94116f7c-4077-445f-95b2-b2800adb5e8b"}]}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:58.045464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:58.046245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:58.052366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.052857 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.053306 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.054044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.054681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.055101 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.077708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.network.neutron [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] validate_networks() for [('94116f7c-4077-445f-95b2-b2800adb5e8b', None, None, None, None, None)] {{(pid=118175) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:10:58.204048 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:58.218932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2760d2b6-a111-4284-b194-edb208ae9464 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1509 microversion: 2.1 time: 0.178153 Aug 05 20:10:58.220307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 416/830] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:58 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:58.241593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:58.242189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:58.252629 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.253148 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.253593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.254515 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.254973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.255402 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.300363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118174) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:10:58.381389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c8da2318-1067-4dbc-8a69-3e63f3cc3c1a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "POST /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f/action" status: 202 len: 0 microversion: 2.1 time: 0.143711 Aug 05 20:10:58.383483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 417/831] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:10:58 2022] POST /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:10:58.392221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:58.393106 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:58.402654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.403469 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.404102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.405019 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.405543 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.405952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.506027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Flavor limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:10:58.506447 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Image limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:10:58.506934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Flavor pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:10:58.507309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Image pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:10:58.507712 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:10:58.523155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.523727 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.524248 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.524975 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.526226 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.527067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.547225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Getting quotas for project b0ab093edb944772ae7b6fd285178a43. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:10:58.557192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Getting quotas for user 6f89a5e4981e423b84d5f28b33bd9629 and project b0ab093edb944772ae7b6fd285178a43. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:10:58.575964 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:58.584951 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7df6c6b4-f356-4222-a787-48f087970bb7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1517 microversion: 2.1 time: 0.197462 Aug 05 20:10:58.585623 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 418/832] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:58 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1517 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:58.591255 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:58.592005 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:58.597964 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.598684 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.599326 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.600284 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.601522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.601955 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.635553 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Going to run 1 instances... {{(pid=118175) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:10:58.638247 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2489de51-75a0-432d-955e-71c7fafad18f',volume_size=None,volume_type=None)] {{(pid=118175) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:10:58.746830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:58.754567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-01ae04df-81ac-42f9-8b9c-d89322895472 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.167758 Aug 05 20:10:58.769715 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 419/833] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:58 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:58.775000 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:58.776177 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:58.782343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.783143 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.785727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.785727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.785727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.785727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.842806 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f5c210fa-d4af-4857-b6c7-91f2acdaf673 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891376 Aug 05 20:10:58.847326 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 415/834] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:10:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:10:58.855424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4bad864d-f9ca-40e9-9063-c1d72e58994f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:58.859712 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4bad864d-f9ca-40e9-9063-c1d72e58994f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:58.942612 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4bad864d-f9ca-40e9-9063-c1d72e58994f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:58.955070 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4bad864d-f9ca-40e9-9063-c1d72e58994f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1094 microversion: 2.1 time: 0.101075 Aug 05 20:10:58.956221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 416/835] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:58 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1094 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:58.961568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:58.962366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:58.971174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.971682 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.972155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.972860 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.973625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.974222 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.018046 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:59.030404 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1bc6def6-97ff-4036-91ab-8dec21896159 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.259229 Aug 05 20:10:59.044502 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 420/836] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:58 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:59.185401 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:59.195607 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-f43b1b8b-cd27-49d1-86f8-98eefb5e2373 req-e9f75294-c536-4aba-8cbd-19807e1a16c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101b95bd-3a7e-45bb-84b4-95f248da5670", "name": "network-vif-plugged", "status": "completed", "tag": "69b936c8-4655-45e3-8477-1b9b83278ede"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:59.216346 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:59.218807 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:59.239235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:59.243068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-86075cc1-5942-41e5-a0ea-f86d5703e969 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.285194 Aug 05 20:10:59.259971 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 417/837] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:58 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:59.263032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-f43b1b8b-cd27-49d1-86f8-98eefb5e2373 req-e9f75294-c536-4aba-8cbd-19807e1a16c9 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:59.263884 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-f43b1b8b-cd27-49d1-86f8-98eefb5e2373 req-e9f75294-c536-4aba-8cbd-19807e1a16c9 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:59.264485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-f43b1b8b-cd27-49d1-86f8-98eefb5e2373 req-e9f75294-c536-4aba-8cbd-19807e1a16c9 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.281683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-f43b1b8b-cd27-49d1-86f8-98eefb5e2373 req-e9f75294-c536-4aba-8cbd-19807e1a16c9 service nova] Creating event network-vif-plugged:69b936c8-4655-45e3-8477-1b9b83278ede for instance 101b95bd-3a7e-45bb-84b4-95f248da5670 on hv-cinder-85221 Aug 05 20:10:59.289599 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-f43b1b8b-cd27-49d1-86f8-98eefb5e2373 req-e9f75294-c536-4aba-8cbd-19807e1a16c9 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098980 Aug 05 20:10:59.290709 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 421/838] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:59.610934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:59.612105 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:59.620503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:59.621379 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:59.622015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.622883 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:59.623558 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:59.624194 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.777683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:59.778382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:59.785784 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:59.786468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:59.787073 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.788041 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:59.788905 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:59.789499 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.796577 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:59.804415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-246dc694-f691-44af-b360-2bcb91e525b7 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.201239 Aug 05 20:10:59.805179 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 418/839] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:59 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:59.935045 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:59.942467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5841cf63-e88c-4b00-9293-7e20a80c29be tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.169955 Aug 05 20:10:59.943033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 422/840] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:59 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:59.976581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:59.977191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:59.983717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:59.984243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:59.984697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.985371 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:59.985828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:59.986280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.051322 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:00.051975 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:00.052409 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:00.058578 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.059103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.059553 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.060295 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.060762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.061230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.069019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-80eeb2fa-cf4d-420d-9538-6fdbeca6e6c5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1136 microversion: 2.1 time: 0.096222 Aug 05 20:11:00.070246 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 419/841] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:59 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1136 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:00.228478 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:00.239851 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1ee83e8c-f9f1-4e29-8fa8-44873a13aef5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.192050 Aug 05 20:11:00.240671 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 423/842] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:00 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:00.270638 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:00.271244 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:00.277919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.278403 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.278842 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.279526 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.280009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.280440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.412256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:00.423076 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:00.424699 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:00.425944 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e982b94c-5e6c-490b-a82e-333b4d9d3cdc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.159411 Aug 05 20:11:00.426533 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 420/843] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:00 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:00.617828 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:00.618403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:00.624634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.625140 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.625844 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.626613 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.627102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.627571 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.715700 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lazy-loading 'services' on Instance uuid 855b7a0d-cc32-490d-90c5-abb6c7b3a67b {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:00.787768 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1ca0d15c-9cc7-49ab-947d-57921a577916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "DELETE /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments/21ec4d68-6b9f-453b-86fa-13f293945717" status: 202 len: 0 microversion: 2.1 time: 0.173602 Aug 05 20:11:00.788803 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 424/844] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:11:00 2022] DELETE /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments/21ec4d68-6b9f-453b-86fa-13f293945717 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:11:00.798120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-82b36f14-d3ff-4b68-8b22-422545513f27 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:00.800451 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-82b36f14-d3ff-4b68-8b22-422545513f27 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:00.807974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82b36f14-d3ff-4b68-8b22-422545513f27 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.808469 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82b36f14-d3ff-4b68-8b22-422545513f27 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.808944 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82b36f14-d3ff-4b68-8b22-422545513f27 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.809647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82b36f14-d3ff-4b68-8b22-422545513f27 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.810106 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82b36f14-d3ff-4b68-8b22-422545513f27 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.810531 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-82b36f14-d3ff-4b68-8b22-422545513f27 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.829852 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:00.830568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:00.836990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.837492 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.838645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.840037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.840533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.840964 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.843520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-82b36f14-d3ff-4b68-8b22-422545513f27 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049425 Aug 05 20:11:00.844263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 421/845] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:00 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:00.963621 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:00.964274 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:00.970474 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.970972 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.971412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.972160 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.972621 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.973055 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.021214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:01.047018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b3f31d74-a119-41e4-ac64-662695830663 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.220334 Aug 05 20:11:01.071111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 425/846] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:00 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:01.095195 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:01.096022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:01.114058 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.117678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.119895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.121448 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.125091 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.125872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.219769 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:01.241192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-736b7e6b-4fd5-429f-a329-fd12c9ca971d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1192 microversion: 2.1 time: 0.153705 Aug 05 20:11:01.242496 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 426/847] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:01 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1192 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:01.267593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:01.268425 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:01.269176 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:01.285618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.286282 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.286732 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.287503 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.288338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.288809 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.294181 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-80f40707-b81b-4d52-a77f-0018c06af6b2 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1367 microversion: 2.1 time: 0.334288 Aug 05 20:11:01.295037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 422/848] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:00 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:01.317347 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-4584ae5c-2560-4946-ae65-4078d4ea2d4a req-e1e474ef-6658-45b5-aa01-4a24d8d23061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e532dd-0c95-4d65-9f31-a698bdfdf52f", "name": "network-vif-unplugged", "status": "completed", "tag": "1a52d740-fd7b-4b85-b351-dfbb3497a9af"}, {"server_uuid": "c94cc1d6-32e5-4c24-8e26-e811d5a25389", "name": "network-vif-plugged", "status": "completed", "tag": "ccf2670a-c2a3-4a62-ad5a-290565f526fe"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:01.346460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4584ae5c-2560-4946-ae65-4078d4ea2d4a req-e1e474ef-6658-45b5-aa01-4a24d8d23061 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.346950 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4584ae5c-2560-4946-ae65-4078d4ea2d4a req-e1e474ef-6658-45b5-aa01-4a24d8d23061 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.347375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4584ae5c-2560-4946-ae65-4078d4ea2d4a req-e1e474ef-6658-45b5-aa01-4a24d8d23061 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.367917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.compute.server_external_events [req-4584ae5c-2560-4946-ae65-4078d4ea2d4a req-e1e474ef-6658-45b5-aa01-4a24d8d23061 service nova] Unable to find a host for instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f. Dropping event network-vif-unplugged {{(pid=118175) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 20:11:01.368725 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-4584ae5c-2560-4946-ae65-4078d4ea2d4a req-e1e474ef-6658-45b5-aa01-4a24d8d23061 service nova] Creating event network-vif-plugged:ccf2670a-c2a3-4a62-ad5a-290565f526fe for instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 on hv-cinder-85221 Aug 05 20:11:01.378193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-4584ae5c-2560-4946-ae65-4078d4ea2d4a req-e1e474ef-6658-45b5-aa01-4a24d8d23061 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.066060 Aug 05 20:11:01.378936 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 423/849] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 05 20:11:01.451464 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:01.452235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:01.458777 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.459195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.459644 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.460578 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.461040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.461512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.470825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:01.482240 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9f5e57c6-673e-400b-8311-8316f3ff1485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.225575 Aug 05 20:11:01.482848 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 427/850] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:01 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:01.685163 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:01.694952 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:01.697639 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:01.699070 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-29f0297b-9bb4-4532-893c-158e28a226b3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.252337 Aug 05 20:11:01.715075 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 424/851] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:01 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:01.857847 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-201c7491-7e95-4b6e-ae0a-313489d3f05e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:01.860433 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-201c7491-7e95-4b6e-ae0a-313489d3f05e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:01.885635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-201c7491-7e95-4b6e-ae0a-313489d3f05e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.886614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-201c7491-7e95-4b6e-ae0a-313489d3f05e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.887516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-201c7491-7e95-4b6e-ae0a-313489d3f05e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.888485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-201c7491-7e95-4b6e-ae0a-313489d3f05e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.888948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-201c7491-7e95-4b6e-ae0a-313489d3f05e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.889567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-201c7491-7e95-4b6e-ae0a-313489d3f05e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.894183 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:01.947556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-201c7491-7e95-4b6e-ae0a-313489d3f05e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095061 Aug 05 20:11:01.948175 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 428/852] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:01 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:02.075076 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:02.075615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:02.083033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.083856 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.084481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.085193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.085658 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.086276 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.259244 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:02.269748 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:02.270565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:02.277486 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9e87df3f-29c7-4427-a95d-2f5761fcd432 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.206286 Aug 05 20:11:02.278782 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.290038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.290038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.290038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.290038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.290507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.290898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 425/853] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:02 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:02.316045 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:02.317104 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:02.326251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.326750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.327252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.327988 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.328441 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.328871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.354898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:02.366706 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8cdf6507-427a-4195-baa7-a44e9e1ec610 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.101233 Aug 05 20:11:02.367455 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 429/854] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:02 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:02.496121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:02.506431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:02.507131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:02.519434 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.519966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.520406 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.521109 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.521577 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.524422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.534258 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-dd24959c-341c-42d4-b920-3d78ebe70978 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1557 microversion: 2.1 time: 0.222160 Aug 05 20:11:02.549521 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 426/855] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:02 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1557 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:02.554437 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c6133a7c-80bc-4347-a932-4f5fef25d73b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:02.554937 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c6133a7c-80bc-4347-a932-4f5fef25d73b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:02.581927 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c6133a7c-80bc-4347-a932-4f5fef25d73b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.582622 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c6133a7c-80bc-4347-a932-4f5fef25d73b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.583215 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c6133a7c-80bc-4347-a932-4f5fef25d73b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.584119 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c6133a7c-80bc-4347-a932-4f5fef25d73b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.584750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c6133a7c-80bc-4347-a932-4f5fef25d73b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.585331 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c6133a7c-80bc-4347-a932-4f5fef25d73b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.669521 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c6133a7c-80bc-4347-a932-4f5fef25d73b tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118642 Aug 05 20:11:02.670194 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 427/856] 10.222.0.95 () {58 vars in 1275 bytes} [Fri Aug 5 20:11:02 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:02.671368 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:02.681447 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-99c4a793-ec1e-49ec-9d22-b428babae717 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.179808 Aug 05 20:11:02.682052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 430/857] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:02 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:02.722185 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:02.722800 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:02.730317 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.730813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.731260 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.732027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.732483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.733015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.960202 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2309a25d-dba2-4691-9a51-b69c0c3e6b40 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:02.962601 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2309a25d-dba2-4691-9a51-b69c0c3e6b40 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:02.970325 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2309a25d-dba2-4691-9a51-b69c0c3e6b40 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.971186 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2309a25d-dba2-4691-9a51-b69c0c3e6b40 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.971873 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2309a25d-dba2-4691-9a51-b69c0c3e6b40 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.972677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2309a25d-dba2-4691-9a51-b69c0c3e6b40 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.973197 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2309a25d-dba2-4691-9a51-b69c0c3e6b40 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.973931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2309a25d-dba2-4691-9a51-b69c0c3e6b40 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.020607 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2309a25d-dba2-4691-9a51-b69c0c3e6b40 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064376 Aug 05 20:11:03.021186 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 431/858] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:02 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:03.089206 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:03.101425 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:03.103011 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:03.104842 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f2a87705-6d19-42b4-9b52-064d35100b71 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.386582 Aug 05 20:11:03.105600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 428/859] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:02 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:03.300905 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:03.301825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:03.308185 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.308713 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.309123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.309844 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.310305 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.310766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.393148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:03.394071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:03.404684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.411350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.411985 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.412857 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.414010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.414551 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.522429 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:03.527513 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:03.531019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-04a111f7-4da1-4962-b552-1691f9a4f105 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.142308 Aug 05 20:11:03.531820 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 429/860] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:03 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:03.535063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-be654a6e-2d9f-4006-9d20-026d69b0d9a4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.238063 Aug 05 20:11:03.535768 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 432/861] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:03 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:03.702067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:03.702803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:03.714621 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.718641 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.719159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.720934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.721458 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.721855 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.974871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:03.982554 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6c72d09c-732b-44af-859b-d62056dff91b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.285094 Aug 05 20:11:03.994766 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 430/862] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:03 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:04.032861 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3e108c59-73d1-4a55-9303-4d4a7f54adc9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:04.036249 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3e108c59-73d1-4a55-9303-4d4a7f54adc9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:04.045002 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e108c59-73d1-4a55-9303-4d4a7f54adc9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.045653 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e108c59-73d1-4a55-9303-4d4a7f54adc9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.046224 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e108c59-73d1-4a55-9303-4d4a7f54adc9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.047097 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e108c59-73d1-4a55-9303-4d4a7f54adc9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.047672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e108c59-73d1-4a55-9303-4d4a7f54adc9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.048434 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3e108c59-73d1-4a55-9303-4d4a7f54adc9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.057151 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-93921530-1619-4f88-8783-62a6af516419 req-0f99da3d-4ed0-431a-82a7-84994474c2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101b95bd-3a7e-45bb-84b4-95f248da5670", "tag": "69b936c8-4655-45e3-8477-1b9b83278ede"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:04.081918 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:04.097726 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-93921530-1619-4f88-8783-62a6af516419 req-0f99da3d-4ed0-431a-82a7-84994474c2aa service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.099384 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3e108c59-73d1-4a55-9303-4d4a7f54adc9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070131 Aug 05 20:11:04.104451 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 431/863] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:04 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:04.107257 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-93921530-1619-4f88-8783-62a6af516419 req-0f99da3d-4ed0-431a-82a7-84994474c2aa service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.108002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-93921530-1619-4f88-8783-62a6af516419 req-0f99da3d-4ed0-431a-82a7-84994474c2aa service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.129600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:04.130423 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:04.136881 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-93921530-1619-4f88-8783-62a6af516419 req-0f99da3d-4ed0-431a-82a7-84994474c2aa service nova] Creating event network-changed:69b936c8-4655-45e3-8477-1b9b83278ede for instance 101b95bd-3a7e-45bb-84b4-95f248da5670 on hv-cinder-85221 Aug 05 20:11:04.145148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.145954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.146503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.147553 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.148229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.148795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.153555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-93921530-1619-4f88-8783-62a6af516419 req-0f99da3d-4ed0-431a-82a7-84994474c2aa service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154828 Aug 05 20:11:04.154791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 433/864] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:04.318727 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:04.327580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:04.329227 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:04.330482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-aee619d5-6b2f-4d76-9da8-b8fa79a68201 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.206396 Aug 05 20:11:04.331129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 432/865] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:04 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:04.557136 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:04.558092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:04.562795 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:04.563541 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:04.573823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.574330 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.574779 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.575501 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.575991 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.576427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.581044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.581695 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.582145 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.582880 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.583444 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.583999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.723376 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:04.733018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7c6a45c3-b29e-4463-b90d-c1b779c62ef5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.183939 Aug 05 20:11:04.747327 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 434/866] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:04 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:04.783065 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:04.797503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0e22db31-df23-4019-8c14-c8363ecab35e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.244471 Aug 05 20:11:04.798752 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 433/867] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:04 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:05.003858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:05.004473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:05.021115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.022000 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.022654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.023602 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.024245 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.024858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.112737 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-20f13dc5-5ab4-43a2-ab94-96b708ab50be tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:05.115343 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-20f13dc5-5ab4-43a2-ab94-96b708ab50be tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:05.129685 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20f13dc5-5ab4-43a2-ab94-96b708ab50be tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.130301 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20f13dc5-5ab4-43a2-ab94-96b708ab50be tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.130829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20f13dc5-5ab4-43a2-ab94-96b708ab50be tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.133582 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20f13dc5-5ab4-43a2-ab94-96b708ab50be tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.134166 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20f13dc5-5ab4-43a2-ab94-96b708ab50be tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.136829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20f13dc5-5ab4-43a2-ab94-96b708ab50be tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.181831 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-20f13dc5-5ab4-43a2-ab94-96b708ab50be tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072796 Aug 05 20:11:05.183811 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 434/868] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:05 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:05.221781 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:05.230507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cc9535cd-9347-4158-b64f-0187fa5a39cf tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.230593 Aug 05 20:11:05.231084 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 435/869] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:04 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:05.358024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:05.358721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:05.365910 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.366324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.366918 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.367755 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.368242 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.369262 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.543207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:05.553771 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:05.555478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:05.557331 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-abfcedb6-33b5-48fa-8d2b-d48a2134c831 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.206281 Aug 05 20:11:05.558042 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 435/870] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:05 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:05.756529 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:05.757004 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:05.776308 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.777127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.777215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.777901 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.778567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.779226 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.822961 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:05.823804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:05.830499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.831074 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.831581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.832389 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.832969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.833493 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.857887 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:05.869335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-695c536d-616c-483c-9f25-2ea09b31f2ac tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.117545 Aug 05 20:11:05.871215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 436/871] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:05 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:06.008296 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:06.020740 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4f7748ad-b840-49a7-ad7b-57c02d80b4e4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.204044 Aug 05 20:11:06.021528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 436/872] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:05 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:06.195475 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-66309f91-0d46-4b0e-8c7f-0a01571e59d1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:06.200742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-66309f91-0d46-4b0e-8c7f-0a01571e59d1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:06.210013 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66309f91-0d46-4b0e-8c7f-0a01571e59d1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.211715 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66309f91-0d46-4b0e-8c7f-0a01571e59d1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.214236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66309f91-0d46-4b0e-8c7f-0a01571e59d1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.216775 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66309f91-0d46-4b0e-8c7f-0a01571e59d1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.217449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66309f91-0d46-4b0e-8c7f-0a01571e59d1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.218271 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-66309f91-0d46-4b0e-8c7f-0a01571e59d1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.254870 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:06.256356 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:06.267080 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.268536 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.269256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.271240 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.273129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.275286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.277290 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-66309f91-0d46-4b0e-8c7f-0a01571e59d1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085600 Aug 05 20:11:06.283173 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 437/873] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:06 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:06.466619 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:06.474336 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9e542f7f-0e76-4b32-9eb2-53a96781b828 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.226708 Aug 05 20:11:06.474997 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 437/874] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:06 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:06.593355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:06.595365 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:06.608725 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.609730 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.610941 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.612723 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.613684 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.614579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.778171 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:06.786130 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:06.787616 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:06.789060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-bcca32c1-08ac-4179-818b-6b626dd0546b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.209321 Aug 05 20:11:06.789614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 438/875] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:06 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:06.893620 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:06.894305 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:06.901444 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.901969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.902412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.903119 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.903575 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.904179 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.970438 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:06.979879 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8bfdac5c-72c9-4ec8-bc6d-c41c3e230de8 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.090146 Aug 05 20:11:06.980978 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 438/876] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:06 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:07.048016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:07.048631 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:07.054705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.055197 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.055637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.057010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.057711 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.058018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.201892 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:07.210634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-342d4290-9c30-4fc2-acc4-554ac5dfcf5c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.166441 Aug 05 20:11:07.224300 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 439/877] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:07 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:07.295795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7a69b65a-debe-4a05-a670-a29a1c3d1579 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:07.295795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7a69b65a-debe-4a05-a670-a29a1c3d1579 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:07.302150 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a69b65a-debe-4a05-a670-a29a1c3d1579 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.304951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a69b65a-debe-4a05-a670-a29a1c3d1579 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.304951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a69b65a-debe-4a05-a670-a29a1c3d1579 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.304951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a69b65a-debe-4a05-a670-a29a1c3d1579 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.304951 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a69b65a-debe-4a05-a670-a29a1c3d1579 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.305388 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a69b65a-debe-4a05-a670-a29a1c3d1579 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.340824 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7a69b65a-debe-4a05-a670-a29a1c3d1579 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054113 Aug 05 20:11:07.341595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 439/878] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:07 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:07.496333 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:07.497125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:07.503599 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.504215 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.504742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.505521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.506055 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.506558 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.648507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:07.658521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f995c59e-f9c2-4c23-aaab-37bb0754fda5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.166510 Aug 05 20:11:07.660224 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 440/879] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:07 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:07.829835 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:07.830939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:07.838095 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.839076 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.840154 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.841340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.842054 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.842772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.002487 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:08.003646 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:08.011142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.012090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.013220 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.013958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.014426 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.014920 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.022900 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:08.033318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:08.035568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:08.037019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-809cef1d-c9ee-4e0d-92b6-70c412f61c61 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.219461 Aug 05 20:11:08.038386 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 440/880] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:07 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:08.095741 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:08.104194 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c1acaeb6-551d-41fd-b854-123847e6a846 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.106383 Aug 05 20:11:08.105011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 441/881] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:07 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:08.234350 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:08.235419 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:08.241792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.242354 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.242895 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.243757 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.244791 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.245438 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.353747 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6ccafe6f-3f71-46ee-9487-0fd7c7b6857a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:08.356134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6ccafe6f-3f71-46ee-9487-0fd7c7b6857a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:08.362409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ccafe6f-3f71-46ee-9487-0fd7c7b6857a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.362902 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ccafe6f-3f71-46ee-9487-0fd7c7b6857a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.363338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ccafe6f-3f71-46ee-9487-0fd7c7b6857a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.364058 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ccafe6f-3f71-46ee-9487-0fd7c7b6857a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.364512 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ccafe6f-3f71-46ee-9487-0fd7c7b6857a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.364937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ccafe6f-3f71-46ee-9487-0fd7c7b6857a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.390524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:08.395304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6ccafe6f-3f71-46ee-9487-0fd7c7b6857a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046095 Aug 05 20:11:08.396208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 442/882] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:08 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:08.398225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-94e984a9-83f0-494a-a9af-e77ddd37537c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.168570 Aug 05 20:11:08.398781 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 441/883] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:08 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:08.680179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:08.680817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:08.687019 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.687503 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.687971 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.688666 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.689124 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.689554 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.841829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:08.849872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5589fd83-1dd5-4694-b2d1-c2a6d8dd74fe tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.173599 Aug 05 20:11:08.860713 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 443/884] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:08 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:09.065955 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:09.066567 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:09.068438 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:09.069309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=8 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:09.075171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.075664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.076139 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.076847 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.077314 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.077744 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.125465 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:09.126098 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:09.131972 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.132457 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.132887 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.133581 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.134044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.135047 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.223468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:09.238796 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:09.240807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0760ee89-3839-47f2-961a-7ec551d08a41 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.118989 Aug 05 20:11:09.245196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 444/885] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:09 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:09.260273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:09.262676 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:09.266165 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d1057c2c-9676-4e13-beaf-c342266c9146 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.202160 Aug 05 20:11:09.283230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 442/886] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:09 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:09.409116 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-fde13c09-5ae7-4115-94d3-63bad13bea6c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:09.412193 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-fde13c09-5ae7-4115-94d3-63bad13bea6c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:09.421323 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:09.422437 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:09.436943 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fde13c09-5ae7-4115-94d3-63bad13bea6c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.437859 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fde13c09-5ae7-4115-94d3-63bad13bea6c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.438414 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.439230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.440068 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fde13c09-5ae7-4115-94d3-63bad13bea6c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.440666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.442211 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fde13c09-5ae7-4115-94d3-63bad13bea6c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.442938 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.443615 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fde13c09-5ae7-4115-94d3-63bad13bea6c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.444109 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-fde13c09-5ae7-4115-94d3-63bad13bea6c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.446049 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.446749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.476862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:09.491235 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-fde13c09-5ae7-4115-94d3-63bad13bea6c tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086594 Aug 05 20:11:09.491990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 445/887] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:09 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:09.602326 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:09.610837 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6c14c6b7-a94f-4463-986b-542989586609 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.194427 Aug 05 20:11:09.611409 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 443/888] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:09 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:09.872754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:09.874145 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:09.881167 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.881745 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.882260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.883039 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.883579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.884702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.029198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:10.036709 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-62e3f20c-8430-4b6d-a7b9-f7f505e2f009 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.169291 Aug 05 20:11:10.037272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 446/889] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:09 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:10.264716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:10.265348 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:10.271307 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.271809 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.272244 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.272919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.273368 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.274178 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.293769 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:10.294390 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:10.300362 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.300843 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.301282 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.301982 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.302439 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.302869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.336748 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:10.344321 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-496575b4-095b-4783-ba2c-018595ce27a9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.084048 Aug 05 20:11:10.344896 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 444/890] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:10 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:10.451505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:10.460275 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:10.461982 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:10.463307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e02138b4-5b23-4799-b5ec-7c3a7980b68b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.173839 Aug 05 20:11:10.464294 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 447/891] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:10 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:10.504316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-353ad306-3701-4739-9603-0b4c34d9052e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:10.506575 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-353ad306-3701-4739-9603-0b4c34d9052e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:10.514112 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-353ad306-3701-4739-9603-0b4c34d9052e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.514610 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-353ad306-3701-4739-9603-0b4c34d9052e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.515050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-353ad306-3701-4739-9603-0b4c34d9052e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.515759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-353ad306-3701-4739-9603-0b4c34d9052e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.516237 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-353ad306-3701-4739-9603-0b4c34d9052e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.516668 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-353ad306-3701-4739-9603-0b4c34d9052e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.547411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-353ad306-3701-4739-9603-0b4c34d9052e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047137 Aug 05 20:11:10.548100 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 445/892] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:10 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:10.632538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:10.633150 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:10.640777 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.641270 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.641812 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.642406 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.642857 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.643283 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.776513 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:10.784470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a84ba202-0a4b-4104-a257-95367c3b506e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.156107 Aug 05 20:11:10.785054 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 448/893] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:10 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:11.059451 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:11.060094 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:11.066061 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.066549 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.066986 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.067675 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.068316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.068745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.198920 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:11.206207 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-418426a8-b11a-4fe0-806c-e94ebac26a33 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.150683 Aug 05 20:11:11.206769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 446/894] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:11 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:11.365555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:11.366166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:11.372865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.373350 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.373785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.374552 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.375018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.375496 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.441226 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:11.449095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0a28b858-c845-4e76-81ff-0abe1efcd76e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.087504 Aug 05 20:11:11.449699 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 449/895] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:11 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:11.485372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:11.486060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:11.492267 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.492759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.493200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.495281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.495281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.495489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.559908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-26cb85c7-dd4c-4f66-9b12-1e9688fa006e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:11.562169 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-26cb85c7-dd4c-4f66-9b12-1e9688fa006e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:11.568481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-26cb85c7-dd4c-4f66-9b12-1e9688fa006e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.568970 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-26cb85c7-dd4c-4f66-9b12-1e9688fa006e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.569409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-26cb85c7-dd4c-4f66-9b12-1e9688fa006e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.570617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-26cb85c7-dd4c-4f66-9b12-1e9688fa006e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.570617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-26cb85c7-dd4c-4f66-9b12-1e9688fa006e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.570964 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-26cb85c7-dd4c-4f66-9b12-1e9688fa006e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.612247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-26cb85c7-dd4c-4f66-9b12-1e9688fa006e tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056936 Aug 05 20:11:11.613027 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 450/896] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:11 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:11.659798 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:11.669556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:11.671078 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:11.672336 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-399dc6a1-0aae-40d7-83e1-bf5910ad7068 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.190821 Aug 05 20:11:11.672815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 447/897] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:11 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:11.808499 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:11.809100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:11.814916 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.815395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.815927 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.816608 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.817061 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.817482 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.957418 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:11.965926 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-34174635-5d01-42eb-ac33-8b610ea88a52 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.162022 Aug 05 20:11:11.966488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 451/898] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:11 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:12.227889 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:12.228514 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:12.234489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.234980 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.235416 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.236138 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.236598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.237027 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.240877 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=100 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:12.365902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:12.373776 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8e64260a-0ebd-4a78-ac27-e034d8bf48ec tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.150491 Aug 05 20:11:12.374341 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 448/899] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:12 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:12.469710 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:12.470350 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:12.476721 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.477205 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.477680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.478481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.478833 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.479255 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.543934 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:12.551390 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4bdf66fc-fcdb-41ea-93ca-f992911ec98a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1200 microversion: 2.1 time: 0.085672 Aug 05 20:11:12.551975 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 452/900] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:12 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1200 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:12.624375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9b3461f4-7708-435e-bbec-2dc32af3cde9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:12.626628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9b3461f4-7708-435e-bbec-2dc32af3cde9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:12.632958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b3461f4-7708-435e-bbec-2dc32af3cde9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.633449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b3461f4-7708-435e-bbec-2dc32af3cde9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.634506 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b3461f4-7708-435e-bbec-2dc32af3cde9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.635213 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b3461f4-7708-435e-bbec-2dc32af3cde9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.635665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b3461f4-7708-435e-bbec-2dc32af3cde9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.636130 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9b3461f4-7708-435e-bbec-2dc32af3cde9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.665160 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9b3461f4-7708-435e-bbec-2dc32af3cde9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Aug 05 20:11:12.665811 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 449/901] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:12 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:12.695753 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:12.697008 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:12.703044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.703527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.703993 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.704683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.705134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.705557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.832291 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:12.840244 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:12.841742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:12.842883 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a7e93ad6-d502-4adf-b09f-7669355a16e3 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.151017 Aug 05 20:11:12.843444 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 453/902] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:12 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:12.987456 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:12.988098 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:12.994622 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.995101 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.995530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.996246 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.996694 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.997116 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.395596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:13.396532 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:13.404520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.405313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.405933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.406647 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.407097 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.407747 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.421982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:13.432218 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fef97f47-4206-4d39-b784-ea2f87fc1c67 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1519 microversion: 2.1 time: 0.448380 Aug 05 20:11:13.433002 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 450/903] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:12 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1519 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:13.574107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:13.574732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:13.581122 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.581806 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.582115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.582911 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.583407 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.583861 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.602016 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:13.611831 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cce1fb1e-4d6b-4f77-bcec-21b6fe667e47 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.220086 Aug 05 20:11:13.612543 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 454/904] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:13 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:13.658576 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:13.667331 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4b9e4064-18b5-46d2-b2d7-807286d7d9fb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1210 microversion: 2.1 time: 0.098167 Aug 05 20:11:13.667947 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 451/905] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:13 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:13.677678 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-20c5e362-09ac-4fbb-b9f9-21b8f96a9057 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:13.680407 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-20c5e362-09ac-4fbb-b9f9-21b8f96a9057 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:13.687358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20c5e362-09ac-4fbb-b9f9-21b8f96a9057 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.687889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20c5e362-09ac-4fbb-b9f9-21b8f96a9057 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.688344 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20c5e362-09ac-4fbb-b9f9-21b8f96a9057 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.689034 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20c5e362-09ac-4fbb-b9f9-21b8f96a9057 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.689521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20c5e362-09ac-4fbb-b9f9-21b8f96a9057 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.689954 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20c5e362-09ac-4fbb-b9f9-21b8f96a9057 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.720527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-20c5e362-09ac-4fbb-b9f9-21b8f96a9057 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047222 Aug 05 20:11:13.721722 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 455/906] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:13 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:13.869652 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:13.870369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:13.877349 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:13.882112 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.883164 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.883614 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.884397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.885071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.885687 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.032073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:14.041815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:14.043808 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:14.045328 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5a04fb0f-5ded-4e3e-b11f-f101e3e3d1f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.180008 Aug 05 20:11:14.056119 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 452/907] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:13 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:14.453421 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:14.454147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:14.460791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.461552 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.462888 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.463704 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.464254 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.464777 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.637108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:14.637838 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:14.645975 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.646208 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.646751 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.648010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.648569 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.649225 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.752783 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:14.763893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2571543a-20ae-4059-ae29-2fb7c9a7f47b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.314263 Aug 05 20:11:14.764870 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 456/908] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:14 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:14.773656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:14.776046 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:14.792575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.794610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.795297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.796718 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.800423 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.801150 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.890479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:14.902103 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0ceb4e89-9133-4e77-8c9a-57942b387e58 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1359 microversion: 2.1 time: 0.271863 Aug 05 20:11:14.902780 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 453/909] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:14 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:14.907889 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c1e1e51d-2115-4e22-954b-8ab813c22489 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:14.910530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c1e1e51d-2115-4e22-954b-8ab813c22489 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:14.920623 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1e1e51d-2115-4e22-954b-8ab813c22489 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.921126 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1e1e51d-2115-4e22-954b-8ab813c22489 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.921795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1e1e51d-2115-4e22-954b-8ab813c22489 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.922466 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1e1e51d-2115-4e22-954b-8ab813c22489 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.923000 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1e1e51d-2115-4e22-954b-8ab813c22489 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.924058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c1e1e51d-2115-4e22-954b-8ab813c22489 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.956633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c1e1e51d-2115-4e22-954b-8ab813c22489 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052749 Aug 05 20:11:14.957227 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 454/910] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:14 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:11:15.047542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:15.048152 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:15.054668 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.055163 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.056206 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.057083 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.057746 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.058364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.089204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:11:15.178500 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f28fc010-7686-4eb8-8672-c732db4fb1a2 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "DELETE /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 204 len: 0 microversion: 2.1 time: 0.136884 Aug 05 20:11:15.179214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 455/911] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:11:15 2022] DELETE /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:11:15.184854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:15.185560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:15.191516 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.192048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.192495 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.193206 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.193669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.194100 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.265320 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:15.272983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0d17e355-0830-477d-8b6f-4fa118d913b7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1278 microversion: 2.1 time: 0.506644 Aug 05 20:11:15.273545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 457/912] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:14 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1278 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:15.278276 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-a7bc8e82-d89d-4aad-a964-c1e22b7b592e req-7da9fa5f-6343-4ef8-afde-9516b51d3d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd121f3-db74-4106-b72b-9145b5df9e78", "tag": "583179e9-2e27-4001-8b5f-31b195762ee5"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:15.287903 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-a7bc8e82-d89d-4aad-a964-c1e22b7b592e req-7da9fa5f-6343-4ef8-afde-9516b51d3d29 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.288388 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-a7bc8e82-d89d-4aad-a964-c1e22b7b592e req-7da9fa5f-6343-4ef8-afde-9516b51d3d29 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.288840 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-a7bc8e82-d89d-4aad-a964-c1e22b7b592e req-7da9fa5f-6343-4ef8-afde-9516b51d3d29 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.300600 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-a7bc8e82-d89d-4aad-a964-c1e22b7b592e req-7da9fa5f-6343-4ef8-afde-9516b51d3d29 service nova] Creating event network-changed:583179e9-2e27-4001-8b5f-31b195762ee5 for instance 1bd121f3-db74-4106-b72b-9145b5df9e78 on hv-cinder-85221 Aug 05 20:11:15.305487 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-a7bc8e82-d89d-4aad-a964-c1e22b7b592e req-7da9fa5f-6343-4ef8-afde-9516b51d3d29 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030489 Aug 05 20:11:15.306930 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 458/913] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:15.312749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:15.313453 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:15.319706 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.320236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.320674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.321781 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.322262 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.322765 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.353527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:15.362470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:15.364010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:15.365166 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5225abd9-3437-45fe-8c9f-e3804098d957 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.184765 Aug 05 20:11:15.365724 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 456/914] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:15 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:15.462207 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:15.472931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0b85896a-1bb1-4e20-bc0a-9fb3ae44a43d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1690 microversion: 2.1 time: 0.164409 Aug 05 20:11:15.474464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 459/915] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:15 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:15.787382 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:15.788399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:15.795527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.796049 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.796488 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.797174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.797626 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.798077 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.923100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:15.923768 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:15.930136 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.931439 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.931889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.932525 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.932987 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.933415 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.933990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:15.941511 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-17a4a02f-12ed-41b8-a797-29b98fb10a37 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.157959 Aug 05 20:11:15.942079 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 457/916] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:15 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:16.061382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.068741 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d6dbcb67-838a-4374-a725-45fdb7bc19ef tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1550 microversion: 2.1 time: 0.149603 Aug 05 20:11:16.069307 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 460/917] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:15 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:16.088612 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:16.089213 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:16.095081 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.095560 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.096030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.096707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.097156 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.097574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.224550 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.233463 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-2571a28e-9c71-4ccd-a2f3-f9239a5e22c6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1550 microversion: 2.1 time: 0.148705 Aug 05 20:11:16.234032 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 458/918] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:16 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:16.253237 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:16.258026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.258829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Searching by: {'deleted': False, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee'} {{(pid=118174) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 20:11:16.265490 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.265973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.266414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.267141 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.267596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.268081 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.294899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:16.295507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:16.301541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.302018 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.302448 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.303138 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.303583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.304035 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.363042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.multi_cell_list [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118174) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 20:11:16.441739 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.450260 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d6507201-085c-447f-b262-52a675b93404 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.159040 Aug 05 20:11:16.450852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 459/919] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:16 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:16.464624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:16.464624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:16.464624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.464624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.465024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.465024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.465024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.465262 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.604892 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.615078 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6ed5404b-1433-4b03-87b3-f6aff810446d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.365404 Aug 05 20:11:16.615241 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.615598 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 461/920] 10.222.0.95 () {58 vars in 1125 bytes} [Fri Aug 5 20:11:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:16.616767 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.618534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4989ad51-1768-4783-84f7-57fbade414d4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.166224 Aug 05 20:11:16.619153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 460/921] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:16 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:16.622170 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:16.622791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:16.628851 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.629344 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.629788 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.630488 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.630948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.631397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.637597 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:16.638204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:16.644259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.644744 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.645183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.645870 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.646353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.646775 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.651365 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:16.767721 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.775827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6e9588b0-3902-47d5-b66f-25963b4972dd tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1690 microversion: 2.1 time: 0.158631 Aug 05 20:11:16.776443 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 462/922] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:16 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:16.779153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.786517 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6e2d50e6-218e-4b88-bc6b-a14710aed5d5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1550 microversion: 2.1 time: 0.153487 Aug 05 20:11:16.787064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 461/923] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:16 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:16.963355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:16.964715 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:16.971686 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.972310 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.972650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.973356 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.973819 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.974248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.011983 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-99f2d777-8d55-44d1-9dc9-b3fc4889cd78 req-7c38877e-5775-44ce-87c7-999d81f79751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9126b58-ee6c-4974-ba02-f2d0384bbb90", "name": "network-vif-plugged", "status": "completed", "tag": "7ee1d147-d81b-4d46-a28d-f1a0289d9691"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:17.027489 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-99f2d777-8d55-44d1-9dc9-b3fc4889cd78 req-7c38877e-5775-44ce-87c7-999d81f79751 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:17.028084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-99f2d777-8d55-44d1-9dc9-b3fc4889cd78 req-7c38877e-5775-44ce-87c7-999d81f79751 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:17.028599 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-99f2d777-8d55-44d1-9dc9-b3fc4889cd78 req-7c38877e-5775-44ce-87c7-999d81f79751 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.042546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-99f2d777-8d55-44d1-9dc9-b3fc4889cd78 req-7c38877e-5775-44ce-87c7-999d81f79751 service nova] Creating event network-vif-plugged:7ee1d147-d81b-4d46-a28d-f1a0289d9691 for instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 on hv-cinder-85221 Aug 05 20:11:17.047395 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-99f2d777-8d55-44d1-9dc9-b3fc4889cd78 req-7c38877e-5775-44ce-87c7-999d81f79751 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039020 Aug 05 20:11:17.048470 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 462/924] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:17.151700 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:17.160482 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-effeb53b-b92f-4e29-93b3-5b98c71d0c6e tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.202051 Aug 05 20:11:17.161055 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 463/925] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:16 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:17.472785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:17.473487 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:17.480287 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:17.480779 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:17.481218 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.481908 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:17.482366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:17.482795 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.617972 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:17.620940 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:17.627716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a10c3bf9-eef9-4180-b89c-339e59d5cc75 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.159220 Aug 05 20:11:17.628324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 463/926] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:17 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:17.641070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:17.641689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:17.647599 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:17.648121 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:17.648566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.649391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:17.649850 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:17.650432 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.784110 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:17.793320 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:17.794849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:17.796071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-727eba83-5322-4017-b341-0b76b779883d tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.158931 Aug 05 20:11:17.796631 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 464/927] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:17 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:17.797265 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:17.797878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:17.804726 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:17.805208 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:17.805756 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.806453 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:17.806906 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:17.807382 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.937451 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:17.945142 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c66c6000-5152-42e7-9749-91c4f94b7979 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1690 microversion: 2.1 time: 0.152006 Aug 05 20:11:17.945703 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 464/928] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:17 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:18.182233 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:18.182850 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:18.189677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.190164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.190604 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.191311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.191873 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.192372 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.330855 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:18.339443 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8fe19267-181c-4b18-aeec-4ff03263c5e1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.161488 Aug 05 20:11:18.340042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 465/929] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:18 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:18.382984 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a63e5352-a09a-40ad-a92d-d8e0c3f25b75 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e700cad-aa05-432b-a96d-539fffb975b1"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:18.385941 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a63e5352-a09a-40ad-a92d-d8e0c3f25b75 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:18.392668 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a63e5352-a09a-40ad-a92d-d8e0c3f25b75 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.393150 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a63e5352-a09a-40ad-a92d-d8e0c3f25b75 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.393581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a63e5352-a09a-40ad-a92d-d8e0c3f25b75 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.394480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a63e5352-a09a-40ad-a92d-d8e0c3f25b75 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.394864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a63e5352-a09a-40ad-a92d-d8e0c3f25b75 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.395288 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a63e5352-a09a-40ad-a92d-d8e0c3f25b75 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.648599 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:18.649795 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:18.655849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.656337 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.656773 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.657460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.657912 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.658338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.789343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:18.797487 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6a5d3cb6-c052-44aa-87b8-d70991123d95 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.153040 Aug 05 20:11:18.798180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 466/930] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:18 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:18.820933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:18.822360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:18.830094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.830576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.831010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.831730 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.832205 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.832629 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.969903 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:18.978503 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:18.980359 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:18.981542 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-193026e1-8334-4e1b-adc8-425a8fe4177f tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.164776 Aug 05 20:11:18.982094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 467/931] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:18 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:18.986494 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:18.987048 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:18.992808 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.994109 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.994715 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.995419 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.995908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.996344 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:19.161108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:19.170973 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-60c4119b-1e61-4f44-aae0-bd364354c111 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1690 microversion: 2.1 time: 0.187902 Aug 05 20:11:19.171532 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 468/932] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:18 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:19.360958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:19.361604 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:19.369539 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:19.370040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:19.370675 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:19.371388 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:19.371904 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:19.372415 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:19.562933 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a63e5352-a09a-40ad-a92d-d8e0c3f25b75 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "POST /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.183636 Aug 05 20:11:19.563620 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 465/933] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:11:18 2022] POST /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments => generated 194 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:19.718027 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:19.726702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6eafb342-3362-405b-8e05-b7355b44984f tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.369584 Aug 05 20:11:19.728112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 469/934] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:19 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:19.819666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:19.820420 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:19.827511 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:19.828046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:19.828479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:19.829169 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:19.829619 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:19.830044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:19.974918 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:20.002068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-07bb6501-c2dd-4800-aced-c670d17c1f7b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.186945 Aug 05 20:11:20.003338 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 466/935] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:19 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:20.004772 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:20.005393 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:20.012362 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:20.012858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:20.013302 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:20.014405 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:20.014876 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:20.015306 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:20.192600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:20.193341 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:20.200252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:20.200839 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:20.201340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:20.202192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:20.202734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:20.203286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:20.217952 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:20.228338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:20.229983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:20.231356 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2d2e8ea2-e008-4b63-bb6c-01fafd7c794a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.230466 Aug 05 20:11:20.232172 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 470/936] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:19 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:20.340315 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:20.351005 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-399188e8-a6c8-4b27-926a-959ccd0efbb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1690 microversion: 2.1 time: 0.162288 Aug 05 20:11:20.351591 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 467/937] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:20 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:20.697357 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-51bd285e-be6c-4f38-a94d-a4b67535c1e5 req-0c112d8c-6004-4540-90c2-59ec88dee78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "855b7a0d-cc32-490d-90c5-abb6c7b3a67b", "name": "network-vif-deleted", "tag": "91cdb80d-7a07-4414-bbf0-8444ba9df127"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:20.703413 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:20.707403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-51bd285e-be6c-4f38-a94d-a4b67535c1e5 req-0c112d8c-6004-4540-90c2-59ec88dee78b service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:20.707921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-51bd285e-be6c-4f38-a94d-a4b67535c1e5 req-0c112d8c-6004-4540-90c2-59ec88dee78b service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:20.708544 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-51bd285e-be6c-4f38-a94d-a4b67535c1e5 req-0c112d8c-6004-4540-90c2-59ec88dee78b service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:20.723692 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-51bd285e-be6c-4f38-a94d-a4b67535c1e5 req-0c112d8c-6004-4540-90c2-59ec88dee78b service nova] Creating event network-vif-deleted:91cdb80d-7a07-4414-bbf0-8444ba9df127 for instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b on hv-cinder-85221 Aug 05 20:11:20.729833 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-51bd285e-be6c-4f38-a94d-a4b67535c1e5 req-0c112d8c-6004-4540-90c2-59ec88dee78b service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036605 Aug 05 20:11:20.730422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 471/938] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:20.749364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:20.749974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:20.757034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:20.757522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:20.757959 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:20.758916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:20.759387 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:20.759817 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:20.920742 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:20.930340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-68648055-964e-4676-9fd6-4572ac0cd20a tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.184895 Aug 05 20:11:20.931604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 468/939] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:20 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:21.025323 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:21.026023 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:21.032142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:21.032626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:21.033060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:21.033755 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:21.034206 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:21.034626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:21.255411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:21.256360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:21.263633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:21.264584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:21.265219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:21.265969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:21.266434 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:21.266867 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:21.272872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:21.286668 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f3366ce6-309f-44b4-a89d-57983eac7398 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.265483 Aug 05 20:11:21.287891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 472/940] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:21 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:21.372219 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:21.372990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:21.379176 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:21.379659 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:21.380412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:21.381312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:21.381933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:21.382954 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:21.419965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:21.420569 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:21.421075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:21.421808 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lazy-loading 'fault' on Instance uuid 855b7a0d-cc32-490d-90c5-abb6c7b3a67b {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:21.436588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:21.444707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:21.447133 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:21.448864 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c608ea76-ec60-4552-b443-ce1d170c6cf4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.198180 Aug 05 20:11:21.449970 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 469/941] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:21 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:21.469796 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:21.478061 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3258a262-b408-47fd-9104-7076fcdef951 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1335 microversion: 2.1 time: 0.109393 Aug 05 20:11:21.478612 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 473/942] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:21 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:21.952974 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:21.953644 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:21.960155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:21.960642 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:21.961080 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:21.961908 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:21.962363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:21.962788 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.098419 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:22.106130 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-dca53aa0-8126-4d24-939b-99842f5b511b tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.157539 Aug 05 20:11:22.106698 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 470/943] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:21 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:22.307827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:22.308615 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:22.315504 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:22.316111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:22.317411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.317686 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:22.318228 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:22.318732 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.466268 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:22.472532 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:22.473209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:22.481431 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:22.481981 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:22.482343 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.483045 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:22.483587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:22.484048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.484248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3833183b-2a0f-4c38-b15c-7b889b22ad21 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.181101 Aug 05 20:11:22.484971 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 474/944] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:22 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:22.503836 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:22.504548 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:22.512478 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:22.513072 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:22.513591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.514513 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:22.515037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:22.515536 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.552539 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:22.553033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:22.553470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.553917 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lazy-loading 'fault' on Instance uuid 855b7a0d-cc32-490d-90c5-abb6c7b3a67b {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:22.596889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:22.607500 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4a248e31-7f09-42e8-8ac2-391191b53398 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1335 microversion: 2.1 time: 0.108111 Aug 05 20:11:22.608250 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 475/945] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:22 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:22.650863 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:22.659070 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:22.660709 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:22.661888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-cc133e7c-0855-42d5-b240-fc7e7dbbd70e tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1730 microversion: 2.20 time: 0.193539 Aug 05 20:11:22.662713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 471/946] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:22 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:23.126992 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:23.127524 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:23.133749 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.134241 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.134685 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.135417 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.135865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.136297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.266572 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:23.274669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2bef0de4-cae4-4420-81fc-ff233a65bef0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.151004 Aug 05 20:11:23.275271 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 476/947] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:23 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:23.505708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:23.506318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:23.513546 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.514029 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.514467 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.515171 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.515612 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.516064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.630530 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:23.631255 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:23.639327 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.639865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.640491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.641131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.641697 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.642139 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.654411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:23.667051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7dd2d4d8-c7da-46ff-ab90-d3f43fb8646d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.164540 Aug 05 20:11:23.668472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 472/948] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:23 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:23.687670 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:23.688063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.688449 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:23.688565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.688970 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.689419 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lazy-loading 'fault' on Instance uuid 855b7a0d-cc32-490d-90c5-abb6c7b3a67b {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:23.694707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.695202 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.695651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.696886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.697452 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.697887 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.730197 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:23.738013 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3f0bbed0-7c38-4eca-829f-14fb4ac40aaf tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 200 len: 1335 microversion: 2.1 time: 0.111469 Aug 05 20:11:23.738657 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 477/949] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:23 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:23.830730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:23.839173 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:23.840717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:23.841848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1cb59b1f-6f63-4d9c-ab89-b434bb622ee6 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1717 microversion: 2.20 time: 0.158745 Aug 05 20:11:23.842400 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 473/950] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:23 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:24.296546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:24.297071 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:24.303267 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:24.303596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:24.304131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:24.304905 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:24.306043 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:24.306652 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:24.526144 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:24.529673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=100 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:24.534490 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1fec66c0-ae1c-45dd-bfa1-99074ddac351 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.241954 Aug 05 20:11:24.535060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 478/951] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:24 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:24.689072 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:24.689678 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:24.697060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:24.697872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:24.698021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:24.698657 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:24.699111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:24.699536 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:24.760138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:24.760925 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 855b7a0d-cc32-490d-90c5-abb6c7b3a67b] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:24.776169 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:24.776686 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:24.777131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:24.777903 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:24.778367 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:24.778844 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:24.794958 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] HTTP exception thrown: Instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b could not be found. Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Request method failure captured: Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b HTTP/1.1 Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XgRdLYKXftSa7cksEAGEmp9Unty8uOHU92P1vhQu2l3nZ6lO4VbDxcp7avQ4TWjJyMjr4KUEYOhJEFSxdqwjwJlC-cSJE7I6c0xXnOWqEBh2Uawuw3PrqmHgcR9ArEHNKV9QL8Mp0h54jpdsmhpmyPQvKUIUi3JBGRjdgvbcu-uHyY Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:11:24.796575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_573a75f13f7240479c725daba27011bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/573a75f13f7240479c725daba27011bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 10705004cfd74f0caddef9db51f1a52c Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b could not be found. Aug 05 20:11:24.798260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': '855b7a0d-cc32-490d-90c5-abb6c7b3a67b'} Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b could not be found. Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:11:24.799442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b could not be found. Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b could not be found. Aug 05 20:11:24.801040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:24.802398 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Returning 404 to user: Instance 855b7a0d-cc32-490d-90c5-abb6c7b3a67b could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:11:24.802398 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b65ea919-0286-4d93-a985-078b186b33a3 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b" status: 404 len: 111 microversion: 2.1 time: 0.043478 Aug 05 20:11:24.802398 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 479/952] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:24 2022] GET /compute/v2.1/servers/855b7a0d-cc32-490d-90c5-abb6c7b3a67b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:11:24.807673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5907dc5c-52ee-4d88-abf6-b0394d7ff09a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '.version_select at 0x7f569666d550>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:24.829241 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5907dc5c-52ee-4d88-abf6-b0394d7ff09a tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744127628" status: 202 len: 0 microversion: 2.1 time: 0.025997 Aug 05 20:11:24.833514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 480/953] 10.222.0.95 () {58 vars in 1218 bytes} [Fri Aug 5 20:11:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744127628 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:11:24.898131 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:24.910146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c88d30a1-c318-4104-aee0-205ebf94ee35 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.224829 Aug 05 20:11:24.926507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 474/954] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:24 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:25.172533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:25.173618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:25.184249 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:25.184839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:25.185286 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:25.186040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:25.186702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:25.187137 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:25.326641 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:25.334675 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-697c164f-c8d7-4eb2-9e62-ddacddb854d6 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1596 microversion: 2.1 time: 0.168884 Aug 05 20:11:25.335246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 481/955] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:25 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1596 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:25.557620 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:25.558247 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:25.565594 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:25.566341 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:25.566600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:25.567457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:25.568119 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:25.568784 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:25.755769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:25.766840 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-16a3ca7c-e331-4eda-ac0c-6336e9051073 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.213912 Aug 05 20:11:25.773499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 475/956] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:25 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:25.934453 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:25.935849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:25.942508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:25.943198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:25.943960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:25.944734 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:25.945265 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:25.945838 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:26.179072 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:26.186933 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-da42fa28-567b-423f-8898-251b58280c62 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.257329 Aug 05 20:11:26.187508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 482/957] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:25 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:26.790467 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:26.791324 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:26.798087 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:26.798580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:26.799019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:26.799946 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:26.800613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:26.801019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:26.956209 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:26.974149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-18aac54f-8323-4412-ba49-5d1eda543c48 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.188615 Aug 05 20:11:26.975050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 476/958] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:26 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:27.208628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:27.210286 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:27.213651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:27.221435 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:27.221944 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:27.222632 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:27.223521 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:27.224011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:27.224687 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:27.300259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-3c69e233-b3ad-4650-8ad6-16bcd6334783 req-0e86020e-9568-4596-9042-d143589eb2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd121f3-db74-4106-b72b-9145b5df9e78", "name": "network-vif-plugged", "status": "completed", "tag": "583179e9-2e27-4001-8b5f-31b195762ee5"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:27.313977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-3c69e233-b3ad-4650-8ad6-16bcd6334783 req-0e86020e-9568-4596-9042-d143589eb2b4 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:27.314852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-3c69e233-b3ad-4650-8ad6-16bcd6334783 req-0e86020e-9568-4596-9042-d143589eb2b4 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:27.315359 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-3c69e233-b3ad-4650-8ad6-16bcd6334783 req-0e86020e-9568-4596-9042-d143589eb2b4 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:27.329403 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-3c69e233-b3ad-4650-8ad6-16bcd6334783 req-0e86020e-9568-4596-9042-d143589eb2b4 service nova] Creating event network-vif-plugged:583179e9-2e27-4001-8b5f-31b195762ee5 for instance 1bd121f3-db74-4106-b72b-9145b5df9e78 on hv-cinder-85221 Aug 05 20:11:27.336649 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-3c69e233-b3ad-4650-8ad6-16bcd6334783 req-0e86020e-9568-4596-9042-d143589eb2b4 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040673 Aug 05 20:11:27.337609 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 477/959] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:27.463667 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:27.471808 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f7d96b72-baa2-4732-be77-03efc22eb8a4 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.267104 Aug 05 20:11:27.472706 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 483/960] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:27 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:27.592251 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-140c1324-ab2c-4795-bece-15091fbbbac4 req-660fec46-20dd-48b5-9844-5ac8f30c2b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94cc1d6-32e5-4c24-8e26-e811d5a25389", "tag": "ccf2670a-c2a3-4a62-ad5a-290565f526fe"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:27.603399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-140c1324-ab2c-4795-bece-15091fbbbac4 req-660fec46-20dd-48b5-9844-5ac8f30c2b51 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:27.604049 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-140c1324-ab2c-4795-bece-15091fbbbac4 req-660fec46-20dd-48b5-9844-5ac8f30c2b51 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:27.604483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-140c1324-ab2c-4795-bece-15091fbbbac4 req-660fec46-20dd-48b5-9844-5ac8f30c2b51 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:27.625037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-140c1324-ab2c-4795-bece-15091fbbbac4 req-660fec46-20dd-48b5-9844-5ac8f30c2b51 service nova] Creating event network-changed:ccf2670a-c2a3-4a62-ad5a-290565f526fe for instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 on hv-cinder-85221 Aug 05 20:11:27.630471 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-140c1324-ab2c-4795-bece-15091fbbbac4 req-660fec46-20dd-48b5-9844-5ac8f30c2b51 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042416 Aug 05 20:11:27.631073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 478/961] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:27.997717 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:27.998519 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:28.008339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:28.009542 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:28.019844 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.021849 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.022083 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.023153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.023656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.025339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.026036 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.027187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.027967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.029437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.029889 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.034017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.088647 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:11:28.125897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:28.190181 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5707060d-4af2-4e0e-a250-330fca483b73 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "DELETE /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 204 len: 0 microversion: 2.1 time: 0.186128 Aug 05 20:11:28.190563 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 479/962] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:11:28 2022] DELETE /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:11:28.199601 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:28.200892 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:28.207214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.207832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.208335 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.209110 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.209828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.210326 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.324517 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:28.333772 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-eb898583-f4af-42a8-bc12-5673790be8e3 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.341872 Aug 05 20:11:28.334931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 484/963] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:27 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:28.387953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:28.395954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-907178d4-8dcc-4c1b-a695-b925405d5e5d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1508 microversion: 2.1 time: 0.200870 Aug 05 20:11:28.396615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 480/964] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:28 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:28.494862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:28.495226 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:28.501595 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.502977 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.503425 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.504191 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.504855 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.505455 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.709097 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:28.717419 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-dc8ff219-ed46-44f5-8294-6d6bda241b12 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.227852 Aug 05 20:11:28.718342 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 485/965] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:28 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:28.875502 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-573517496"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:28.876070 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:28.881909 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.882383 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.882816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.883522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:28.884177 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:28.884605 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.165892 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.network.security_group_api [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Adding security group 26a225f3-8376-4262-9cb5-1989ad9461d5 to port ccf2670a-c2a3-4a62-ad5a-290565f526fe Aug 05 20:11:29.355112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-acc6a287-b2d9-494a-991b-cb91de0c928b req-7c747b1a-bb17-45a7-81aa-952fd95e53e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e532dd-0c95-4d65-9f31-a698bdfdf52f", "name": "network-vif-plugged", "status": "completed", "tag": "1a52d740-fd7b-4b85-b351-dfbb3497a9af"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:29.365997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-acc6a287-b2d9-494a-991b-cb91de0c928b req-7c747b1a-bb17-45a7-81aa-952fd95e53e1 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.366165 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-acc6a287-b2d9-494a-991b-cb91de0c928b req-7c747b1a-bb17-45a7-81aa-952fd95e53e1 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.366599 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-acc6a287-b2d9-494a-991b-cb91de0c928b req-7c747b1a-bb17-45a7-81aa-952fd95e53e1 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.378201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-acc6a287-b2d9-494a-991b-cb91de0c928b req-7c747b1a-bb17-45a7-81aa-952fd95e53e1 service nova] Creating event network-vif-plugged:1a52d740-fd7b-4b85-b351-dfbb3497a9af for instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f on hv-cinder-85221 Aug 05 20:11:29.384251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-acc6a287-b2d9-494a-991b-cb91de0c928b req-7c747b1a-bb17-45a7-81aa-952fd95e53e1 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033153 Aug 05 20:11:29.385297 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 486/966] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:29.390956 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:29.391686 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:29.397890 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.398388 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.399468 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.400203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.400669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.401098 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.535457 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:29.539034 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-723c3676-dd2a-4f1e-9bc9-14870e6e1270 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "POST /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/action" status: 202 len: 0 microversion: 2.1 time: 0.667358 Aug 05 20:11:29.543729 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 481/967] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:11:28 2022] POST /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:11:29.545222 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-672040ac-2d7e-4187-b2d4-3aab20aad664 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.158741 Aug 05 20:11:29.545792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 487/968] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:29 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:29.548479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:29.549100 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:29.550803 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:29.551577 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:29.556084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.556593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.557037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.557750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.558211 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.558644 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.560395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.561319 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.563950 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.565537 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.565988 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.566430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.710930 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:29.720199 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-10889a43-dda0-4ee6-9ae1-b4653d9ec3c5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1508 microversion: 2.1 time: 0.175211 Aug 05 20:11:29.720786 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 482/969] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:29 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:29.725809 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-f44cc516-83da-4f7e-9c97-d510d9075425 req-4759d4b3-7609-4f27-8d62-66e682c519bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94cc1d6-32e5-4c24-8e26-e811d5a25389", "tag": "ccf2670a-c2a3-4a62-ad5a-290565f526fe"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:29.734464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:29.743018 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-f44cc516-83da-4f7e-9c97-d510d9075425 req-4759d4b3-7609-4f27-8d62-66e682c519bd service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.743606 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-f44cc516-83da-4f7e-9c97-d510d9075425 req-4759d4b3-7609-4f27-8d62-66e682c519bd service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.744124 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-f44cc516-83da-4f7e-9c97-d510d9075425 req-4759d4b3-7609-4f27-8d62-66e682c519bd service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.745090 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-225f6c41-e312-48e4-aa48-b90c548eb4c5 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1642 microversion: 2.1 time: 0.198147 Aug 05 20:11:29.745953 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 488/970] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:29 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1642 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:29.750888 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:29.752331 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:29.758093 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-f44cc516-83da-4f7e-9c97-d510d9075425 req-4759d4b3-7609-4f27-8d62-66e682c519bd service nova] Creating event network-changed:ccf2670a-c2a3-4a62-ad5a-290565f526fe for instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 on hv-cinder-85221 Aug 05 20:11:29.759490 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.760404 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.761101 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.762397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.762935 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.763588 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.764233 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-f44cc516-83da-4f7e-9c97-d510d9075425 req-4759d4b3-7609-4f27-8d62-66e682c519bd service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041946 Aug 05 20:11:29.765260 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 483/971] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:29.898065 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:29.906271 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-defce339-4358-4847-8932-7d31598d43da tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1266 microversion: 2.1 time: 0.158936 Aug 05 20:11:29.906851 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 489/972] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:29 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:30.569102 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:30.569804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:30.576195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.576681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.577125 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.577847 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.578307 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.578737 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.721020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:30.729428 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-2219bea5-953b-4fd3-8221-57704e307e08 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.164921 Aug 05 20:11:30.730008 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 484/973] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:30 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:30.741514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:30.742138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:30.749435 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.749928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.750370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.751110 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.751570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.752034 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.929277 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:30.929977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:30.937353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.937978 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.938415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.939283 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.939938 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.940520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.013144 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:31.020538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-15fedd90-7cfd-41ed-bbdd-54f9c60d38b9 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1508 microversion: 2.1 time: 0.283067 Aug 05 20:11:31.021467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 490/974] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:30 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:31.073606 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:31.081136 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1bf35675-b873-4d86-b01f-7799601c84f1 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1453 microversion: 2.1 time: 0.156056 Aug 05 20:11:31.081708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 485/975] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:30 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:31.106439 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:31.107049 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:31.115044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.115523 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.115991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.116677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.117124 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.117544 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.249225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:31.257021 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8c604b9d-c7d1-4cfc-a2fa-98f3cf1b3469 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1453 microversion: 2.1 time: 0.157706 Aug 05 20:11:31.257883 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 491/976] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:31 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:31.752217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:31.753677 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:31.761611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.762227 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.762678 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.763484 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.764059 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.764725 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.898291 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:31.907181 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-941b8ea3-853a-45fd-9f4c-84dcdab75378 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.160050 Aug 05 20:11:31.907762 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 486/977] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:31 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:32.043948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:32.046190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:32.054171 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:32.054664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:32.055102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:32.055833 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:32.057817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:32.058528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:32.457722 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:32.467157 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6c62a25b-8f37-4fc1-8c1f-1151ff231261 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1508 microversion: 2.1 time: 0.428761 Aug 05 20:11:32.468026 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 492/978] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:32 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1508 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:32.665417 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-6766f692-48c5-4a2f-9bfa-53b9a7ccd5d4 req-2d4bb9f6-df4e-4e33-86d0-8c3ca7db398c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa307a20-721c-423c-88a3-4b3596b78533", "name": "network-vif-deleted", "tag": "07d09ee9-eb0d-4e91-8ac3-af5d1f7ce9fe"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:32.679772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-6766f692-48c5-4a2f-9bfa-53b9a7ccd5d4 req-2d4bb9f6-df4e-4e33-86d0-8c3ca7db398c service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:32.680565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-6766f692-48c5-4a2f-9bfa-53b9a7ccd5d4 req-2d4bb9f6-df4e-4e33-86d0-8c3ca7db398c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:32.681309 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-6766f692-48c5-4a2f-9bfa-53b9a7ccd5d4 req-2d4bb9f6-df4e-4e33-86d0-8c3ca7db398c service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:32.694058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-6766f692-48c5-4a2f-9bfa-53b9a7ccd5d4 req-2d4bb9f6-df4e-4e33-86d0-8c3ca7db398c service nova] Creating event network-vif-deleted:07d09ee9-eb0d-4e91-8ac3-af5d1f7ce9fe for instance aa307a20-721c-423c-88a3-4b3596b78533 on hv-cinder-85221 Aug 05 20:11:32.699991 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-6766f692-48c5-4a2f-9bfa-53b9a7ccd5d4 req-2d4bb9f6-df4e-4e33-86d0-8c3ca7db398c service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038492 Aug 05 20:11:32.700595 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 487/979] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:32.929477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:32.930228 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:32.942352 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:32.943004 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:32.943575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:32.944434 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:32.944997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:32.945644 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:33.186500 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:33.194688 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5fbdc49d-f9f8-41d5-9522-bf6a6f969ba1 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1575 microversion: 2.1 time: 0.269977 Aug 05 20:11:33.195256 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 493/980] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:32 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:33.489085 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:33.489674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:33.501633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:33.502128 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:33.502572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:33.503277 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:33.503734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:33.504187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:33.539320 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:33.540007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:33.541301 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:33.542022 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lazy-loading 'fault' on Instance uuid aa307a20-721c-423c-88a3-4b3596b78533 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:33.594518 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:33.602664 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-87f85ed1-dbc4-4a54-a05c-23297221531d tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 200 len: 1311 microversion: 2.1 time: 0.118410 Aug 05 20:11:33.603941 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 488/981] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:33 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:34.217867 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:34.219085 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:34.226011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.226803 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.227547 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.228682 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.229457 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.230043 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.394778 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:34.402588 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-155b3596-a6f7-464f-abfc-fb12ab2eafe4 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1562 microversion: 2.1 time: 0.188612 Aug 05 20:11:34.403159 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 494/982] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:34 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1562 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:34.624320 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:34.624930 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: aa307a20-721c-423c-88a3-4b3596b78533] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:34.631307 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.631806 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.632262 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.632958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.633412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.633841 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.648074 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] HTTP exception thrown: Instance aa307a20-721c-423c-88a3-4b3596b78533 could not be found. Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Request method failure captured: Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 HTTP/1.1 Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XgRdLYKXftSa7cksEAGEmp9Unty8uOHU92P1vhQu2l3nZ6lO4VbDxcp7avQ4TWjJyMjr4KUEYOhJEFSxdqwjwJlC-cSJE7I6c0xXnOWqEBh2Uawuw3PrqmHgcR9ArEHNKV9QL8Mp0h54jpdsmhpmyPQvKUIUi3JBGRjdgvbcu-uHyY Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:11:34.649731 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_573a75f13f7240479c725daba27011bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/573a75f13f7240479c725daba27011bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 10705004cfd74f0caddef9db51f1a52c Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance aa307a20-721c-423c-88a3-4b3596b78533 could not be found. Aug 05 20:11:34.652174 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'aa307a20-721c-423c-88a3-4b3596b78533'} Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa307a20-721c-423c-88a3-4b3596b78533 could not be found. Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:11:34.653191 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa307a20-721c-423c-88a3-4b3596b78533 could not be found. Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa307a20-721c-423c-88a3-4b3596b78533 could not be found. Aug 05 20:11:34.654360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:11:34.655494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Returning 404 to user: Instance aa307a20-721c-423c-88a3-4b3596b78533 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:11:34.655494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1c55c1b1-1bdf-44a7-8606-d00843f57e98 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533" status: 404 len: 111 microversion: 2.1 time: 0.031475 Aug 05 20:11:34.655494 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 489/983] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:34 2022] GET /compute/v2.1/servers/aa307a20-721c-423c-88a3-4b3596b78533 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:11:34.660697 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:34.661197 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:34.667465 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.667986 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.668435 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.669131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.669584 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.670010 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.694585 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Going to try to terminate instance {{(pid=118174) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:11:34.717119 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-401424ee-9ac2-4a68-b13e-2b42062a3f70 req-53412803-d517-4b35-a485-e871679d49fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd121f3-db74-4106-b72b-9145b5df9e78", "tag": "583179e9-2e27-4001-8b5f-31b195762ee5"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:34.726956 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-401424ee-9ac2-4a68-b13e-2b42062a3f70 req-53412803-d517-4b35-a485-e871679d49fd service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.727436 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-401424ee-9ac2-4a68-b13e-2b42062a3f70 req-53412803-d517-4b35-a485-e871679d49fd service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.727896 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-401424ee-9ac2-4a68-b13e-2b42062a3f70 req-53412803-d517-4b35-a485-e871679d49fd service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.746054 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-401424ee-9ac2-4a68-b13e-2b42062a3f70 req-53412803-d517-4b35-a485-e871679d49fd service nova] Creating event network-changed:583179e9-2e27-4001-8b5f-31b195762ee5 for instance 1bd121f3-db74-4106-b72b-9145b5df9e78 on hv-cinder-85221 Aug 05 20:11:34.752581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-401424ee-9ac2-4a68-b13e-2b42062a3f70 req-53412803-d517-4b35-a485-e871679d49fd service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039656 Aug 05 20:11:34.753245 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 490/984] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:34.808208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f249b416-30ae-4542-a633-b6ade4859780 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "DELETE /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 204 len: 0 microversion: 2.1 time: 0.150941 Aug 05 20:11:34.809702 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 495/985] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:11:34 2022] DELETE /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:11:34.818384 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:34.819135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:34.825671 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.826159 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.826600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.827298 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.827954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.828580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.969084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:34.976992 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c30901d4-bd01-4732-ab4c-9bd95aaf5887 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.162797 Aug 05 20:11:34.977566 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 491/986] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:34 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:36.000573 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:36.001274 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:36.007707 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:36.008500 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:36.008943 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:36.010280 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:36.010832 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:36.011264 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:36.015260 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:36.150222 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:36.157792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-dd4a22e9-1ec1-40a2-a96d-e42231299916 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.162026 Aug 05 20:11:36.158353 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 496/987] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:35 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:37.179561 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:37.180204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:37.187307 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:37.187803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:37.188254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.188941 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:37.189390 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:37.189809 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.320167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:37.327701 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-dffc79de-f792-422b-b088-6f1f23526ac5 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1523 microversion: 2.1 time: 0.151968 Aug 05 20:11:37.328392 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 492/988] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:37 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:38.349626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:38.350467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:38.358506 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:38.359132 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:38.359647 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:38.360526 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:38.361092 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:38.361602 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:38.465225 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10705004cfd74f0caddef9db51f1a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573a75f13f7240479c725daba27011bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:38.474063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-dcaf5615-d054-45d2-95a0-66f001209bb1 tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 200 len: 1481 microversion: 2.1 time: 0.128497 Aug 05 20:11:38.474754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 497/989] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:38 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 1481 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:38.476015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-140436e6-cb60-4050-b1a4-9827e6aa21e0 req-9ad52422-c797-4885-a876-b91d081139ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfe824c-c06c-4210-8616-5c6f7331d1a2", "name": "network-vif-deleted", "tag": "86f96b12-e991-4913-b831-de7201be0e33"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:38.486120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-140436e6-cb60-4050-b1a4-9827e6aa21e0 req-9ad52422-c797-4885-a876-b91d081139ff service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:38.486606 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-140436e6-cb60-4050-b1a4-9827e6aa21e0 req-9ad52422-c797-4885-a876-b91d081139ff service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:38.487037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-140436e6-cb60-4050-b1a4-9827e6aa21e0 req-9ad52422-c797-4885-a876-b91d081139ff service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:38.498486 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-140436e6-cb60-4050-b1a4-9827e6aa21e0 req-9ad52422-c797-4885-a876-b91d081139ff service nova] Creating event network-vif-deleted:86f96b12-e991-4913-b831-de7201be0e33 for instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 on hv-cinder-85221 Aug 05 20:11:38.503143 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-140436e6-cb60-4050-b1a4-9827e6aa21e0 req-9ad52422-c797-4885-a876-b91d081139ff service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030721 Aug 05 20:11:38.503734 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 493/990] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:39.495559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:39.496221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] [instance: 2cfe824c-c06c-4210-8616-5c6f7331d1a2] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:39.502214 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:39.502698 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:39.503130 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:39.503839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:39.504292 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:39.504710 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:39.518836 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] HTTP exception thrown: Instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 could not be found. Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Request method failure captured: Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 HTTP/1.1 Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XgRdLYKXftSa7cksEAGEmp9Unty8uOHU92P1vhQu2l3nZ6lO4VbDxcp7avQ4TWjJyMjr4KUEYOhJEFSxdqwjwJlC-cSJE7I6c0xXnOWqEBh2Uawuw3PrqmHgcR9ArEHNKV9QL8Mp0h54jpdsmhpmyPQvKUIUi3JBGRjdgvbcu-uHyY Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:11:39.520495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_573a75f13f7240479c725daba27011bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/573a75f13f7240479c725daba27011bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/573a75f13f7240479c725daba27011bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 573a75f13f7240479c725daba27011bf Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154481454 Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 10705004cfd74f0caddef9db51f1a52c Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154481454-project Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 could not be found. Aug 05 20:11:39.522112 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': '2cfe824c-c06c-4210-8616-5c6f7331d1a2'} Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 could not be found. Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:11:39.523213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 could not be found. Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 could not be found. Aug 05 20:11:39.525375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:11:39.526888 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] Returning 404 to user: Instance 2cfe824c-c06c-4210-8616-5c6f7331d1a2 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:11:39.526888 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ad77bb46-1e21-4c3f-9e6b-db8c3ceb493f tempest-ServerRescueNegativeTestJSON-154481454 tempest-ServerRescueNegativeTestJSON-154481454-project] 10.222.0.95 "GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2" status: 404 len: 111 microversion: 2.1 time: 0.030630 Aug 05 20:11:39.526888 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 498/991] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:39 2022] GET /compute/v2.1/servers/2cfe824c-c06c-4210-8616-5c6f7331d1a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:11:47.753142 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8b7c021f-d4ad-4e18-a464-dd8786083776 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:47.754347 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8b7c021f-d4ad-4e18-a464-dd8786083776 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:47.757554 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:47.762958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8b7c021f-d4ad-4e18-a464-dd8786083776 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:47.764009 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8b7c021f-d4ad-4e18-a464-dd8786083776 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:47.764622 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8b7c021f-d4ad-4e18-a464-dd8786083776 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:47.765339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8b7c021f-d4ad-4e18-a464-dd8786083776 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:47.766104 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8b7c021f-d4ad-4e18-a464-dd8786083776 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:47.766708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8b7c021f-d4ad-4e18-a464-dd8786083776 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:47.793459 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8b7c021f-d4ad-4e18-a464-dd8786083776 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/ips" status: 200 len: 150 microversion: 2.1 time: 0.045046 Aug 05 20:11:47.794046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 494/992] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:11:47 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:48.465524 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9af4ab29-5c95-4b35-8ba3-cacac0ae6b4b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'create', calling method: .version_select at 0x7f5691d0a700>, body: {"keypair": {"name": "tempest-keypair-465673037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyS59J+ZB5dek9zEX/fEK9c7B2vpWYDXzc71XbRguNdu1VCqp6VCqBNdGL9suty8emiO5y+9i8CWOehlfjNR0M2B15r4NCFgL+knHfSH7hZ/7+A1cYYjOPq0tle3evu7w=="}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:48.482438 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-9af4ab29-5c95-4b35-8ba3-cacac0ae6b4b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Getting quotas for project d3f34fc2ca3d4b32be53a5658100a336. Resources: {'key_pairs'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:11:48.486397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-9af4ab29-5c95-4b35-8ba3-cacac0ae6b4b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Getting quotas for user 1aff2581168d4498ad3823ed3e4ff3f9 and project d3f34fc2ca3d4b32be53a5658100a336. Resources: {'key_pairs'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:11:48.509965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9af4ab29-5c95-4b35-8ba3-cacac0ae6b4b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171788 Aug 05 20:11:48.510900 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 499/993] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:11:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:49.209930 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-a2d9d413-813e-4bc1-a7a3-544b9e706287 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89d8f912-5dd8-4a2f-be60-6cc840f48892"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:49.212832 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-a2d9d413-813e-4bc1-a7a3-544b9e706287 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:49.219084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2d9d413-813e-4bc1-a7a3-544b9e706287 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.219794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2d9d413-813e-4bc1-a7a3-544b9e706287 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.220573 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2d9d413-813e-4bc1-a7a3-544b9e706287 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.221571 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2d9d413-813e-4bc1-a7a3-544b9e706287 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.222339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2d9d413-813e-4bc1-a7a3-544b9e706287 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.222788 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-a2d9d413-813e-4bc1-a7a3-544b9e706287 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.529995 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-a2d9d413-813e-4bc1-a7a3-544b9e706287 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "POST /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323816 Aug 05 20:11:49.530872 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 495/994] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:11:49 2022] POST /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:49.878852 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=12 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:49.884203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-761807189", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d27ed54c-ce86-461d-a6cf-3258bf554f65"}], "security_groups": [{"name": "tempest-securitygroup--2019664913"}], "key_name": "tempest-keypair-465673037", "user_data": "}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:50.001391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] validate_networks() for [('d27ed54c-ce86-461d-a6cf-3258bf554f65', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:11:50.397937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:11:50.398406 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:11:50.398837 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:11:50.399877 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:11:50.400432 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:11:50.410513 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:50.414433 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:50.415516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:50.416928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:50.417579 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:50.418115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:50.438442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Getting quotas for project d3f34fc2ca3d4b32be53a5658100a336. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:11:50.442455 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Getting quotas for user 1aff2581168d4498ad3823ed3e4ff3f9 and project d3f34fc2ca3d4b32be53a5658100a336. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:11:50.453839 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:11:50.456152 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:11:50.505485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5bb6bfc6-7c34-46a2-96ee-aaed0f3fc086 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627650 Aug 05 20:11:50.506351 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 500/995] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:11:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 20:11:50.517968 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5f9c860b-509d-4e2a-94df-ebb361b3d6a2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:50.518666 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5f9c860b-509d-4e2a-94df-ebb361b3d6a2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:50.580111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5f9c860b-509d-4e2a-94df-ebb361b3d6a2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:50.589304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5f9c860b-509d-4e2a-94df-ebb361b3d6a2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1236 microversion: 2.1 time: 0.075128 Aug 05 20:11:50.589895 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 496/996] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:50 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:51.610519 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:51.611138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:51.614465 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:51.621647 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:51.622383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:51.622823 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:51.623541 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:51.624032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:51.624627 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:51.704565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:51.714341 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-81775ca0-7b7e-4867-8d4a-e25718b41bce tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1288 microversion: 2.1 time: 0.107698 Aug 05 20:11:51.727996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 501/997] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:51 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:52.735676 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:52.736490 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:52.747243 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:52.750006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:52.750879 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:52.752044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:52.752707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:52.753314 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:52.932604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:52.940260 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f29b9a99-f613-49c9-8076-14b4c830e7e2 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1362 microversion: 2.1 time: 0.209145 Aug 05 20:11:52.942080 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 497/998] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:52 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:53.476257 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-9cfb42db-d640-463a-ba5e-8c655c31a946 req-28a00b26-079b-455a-b1c6-6b5362f23e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd18fa6-7db0-4b85-a28a-3ddb1f058787", "tag": "1f42ea8e-3479-4841-ad1f-660c26f3b807"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:53.487601 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-9cfb42db-d640-463a-ba5e-8c655c31a946 req-28a00b26-079b-455a-b1c6-6b5362f23e93 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:53.488139 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-9cfb42db-d640-463a-ba5e-8c655c31a946 req-28a00b26-079b-455a-b1c6-6b5362f23e93 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:53.488566 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-9cfb42db-d640-463a-ba5e-8c655c31a946 req-28a00b26-079b-455a-b1c6-6b5362f23e93 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:53.500656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-9cfb42db-d640-463a-ba5e-8c655c31a946 req-28a00b26-079b-455a-b1c6-6b5362f23e93 service nova] Creating event network-changed:1f42ea8e-3479-4841-ad1f-660c26f3b807 for instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 on hv-cinder-85221 Aug 05 20:11:53.505430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-9cfb42db-d640-463a-ba5e-8c655c31a946 req-28a00b26-079b-455a-b1c6-6b5362f23e93 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032933 Aug 05 20:11:53.506025 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 502/999] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:53.960808 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:53.961908 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:53.968493 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:53.968981 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:53.969418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:53.970113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:53.970569 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:53.970999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:54.109323 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:54.111637 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:54.118792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3b5b841f-6e10-450a-8693-b84a3e5255ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1362 microversion: 2.1 time: 0.161239 Aug 05 20:11:54.119365 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 498/1000] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:53 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:55.140129 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:55.141000 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:55.147223 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:55.147799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:55.148247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:55.148941 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:55.149390 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:55.149812 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:55.350877 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:55.358641 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-68ac8911-9255-45c2-982c-d853d030bd05 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1362 microversion: 2.1 time: 0.223819 Aug 05 20:11:55.359211 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 503/1001] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:55 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:56.379475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:56.380053 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:56.388334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:56.388834 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:56.389267 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:56.389948 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:56.390398 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:56.390824 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:56.532028 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:56.540203 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-10160594-bed7-416d-933d-75862135168e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1362 microversion: 2.1 time: 0.164901 Aug 05 20:11:56.540835 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 499/1002] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:56 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:57.239055 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:57.239596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:57.248813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:57.249347 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:57.249918 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:57.250654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:57.251111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:57.251544 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:57.332703 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'services' on Instance uuid 101b95bd-3a7e-45bb-84b4-95f248da5670 {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:57.409523 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c348d176-b357-469d-9a8f-53e0d9a2cebe tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments/89d8f912-5dd8-4a2f-be60-6cc840f48892" status: 202 len: 0 microversion: 2.1 time: 0.174365 Aug 05 20:11:57.410120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 504/1003] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:11:57 2022] DELETE /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments/89d8f912-5dd8-4a2f-be60-6cc840f48892 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:11:57.420452 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bf2b9f1d-829f-45f8-a59f-eb52c044115a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:57.423558 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bf2b9f1d-829f-45f8-a59f-eb52c044115a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:57.430919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf2b9f1d-829f-45f8-a59f-eb52c044115a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:57.432543 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf2b9f1d-829f-45f8-a59f-eb52c044115a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:57.433227 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf2b9f1d-829f-45f8-a59f-eb52c044115a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:57.434762 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf2b9f1d-829f-45f8-a59f-eb52c044115a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:57.435232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf2b9f1d-829f-45f8-a59f-eb52c044115a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:57.435672 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bf2b9f1d-829f-45f8-a59f-eb52c044115a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:57.473153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bf2b9f1d-829f-45f8-a59f-eb52c044115a tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058041 Aug 05 20:11:57.474015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 500/1004] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:57 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:57.561288 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:57.561985 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:57.568394 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:57.568875 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:57.569312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:57.570003 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:57.570457 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:57.570879 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:57.715287 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:57.723547 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-203f4479-84c4-4710-ac16-012ec85bc704 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1362 microversion: 2.1 time: 0.166446 Aug 05 20:11:57.724167 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 505/1005] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:57 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:58.487064 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-97783c2d-6349-4a30-952c-313c6e79a83f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:58.489563 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-97783c2d-6349-4a30-952c-313c6e79a83f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:58.496738 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-97783c2d-6349-4a30-952c-313c6e79a83f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:58.497220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-97783c2d-6349-4a30-952c-313c6e79a83f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:58.497674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-97783c2d-6349-4a30-952c-313c6e79a83f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:58.498355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-97783c2d-6349-4a30-952c-313c6e79a83f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:58.498808 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-97783c2d-6349-4a30-952c-313c6e79a83f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:58.499232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-97783c2d-6349-4a30-952c-313c6e79a83f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:58.529902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-97783c2d-6349-4a30-952c-313c6e79a83f tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047208 Aug 05 20:11:58.531146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 501/1006] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:58 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:58.748948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:58.749465 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:58.755339 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:58.755898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:58.756338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:58.757018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:58.757467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:58.757889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:58.888898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:58.896639 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d4ffc378-6311-4581-b931-68800b3af46e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1362 microversion: 2.1 time: 0.152678 Aug 05 20:11:58.897191 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 506/1007] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:58 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:59.344084 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-13f4ae0a-f8d7-4e30-ace4-ec0f2225fd72 req-26942dee-7c80-484b-9be5-723f8e55a262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd18fa6-7db0-4b85-a28a-3ddb1f058787", "name": "network-vif-plugged", "status": "completed", "tag": "1f42ea8e-3479-4841-ad1f-660c26f3b807"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:59.354303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-13f4ae0a-f8d7-4e30-ace4-ec0f2225fd72 req-26942dee-7c80-484b-9be5-723f8e55a262 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.354737 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-13f4ae0a-f8d7-4e30-ace4-ec0f2225fd72 req-26942dee-7c80-484b-9be5-723f8e55a262 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.355418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-13f4ae0a-f8d7-4e30-ace4-ec0f2225fd72 req-26942dee-7c80-484b-9be5-723f8e55a262 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.366574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-13f4ae0a-f8d7-4e30-ace4-ec0f2225fd72 req-26942dee-7c80-484b-9be5-723f8e55a262 service nova] Creating event network-vif-plugged:1f42ea8e-3479-4841-ad1f-660c26f3b807 for instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 on hv-cinder-85221 Aug 05 20:11:59.372464 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-13f4ae0a-f8d7-4e30-ace4-ec0f2225fd72 req-26942dee-7c80-484b-9be5-723f8e55a262 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032190 Aug 05 20:11:59.373056 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 502/1008] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:59.543317 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-330cce3b-43d1-4f9d-a66f-18028e6e5258 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:59.545698 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-330cce3b-43d1-4f9d-a66f-18028e6e5258 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:59.552957 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-330cce3b-43d1-4f9d-a66f-18028e6e5258 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.553449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-330cce3b-43d1-4f9d-a66f-18028e6e5258 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.553888 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-330cce3b-43d1-4f9d-a66f-18028e6e5258 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.554587 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-330cce3b-43d1-4f9d-a66f-18028e6e5258 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.555042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-330cce3b-43d1-4f9d-a66f-18028e6e5258 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.555466 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-330cce3b-43d1-4f9d-a66f-18028e6e5258 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.587020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-330cce3b-43d1-4f9d-a66f-18028e6e5258 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048363 Aug 05 20:11:59.587586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 507/1009] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:59 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:11:59.653067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:59.653677 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:59.659880 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.660369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.660806 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.661768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.662223 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.662649 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.687932 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:11:59.763226 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e8a3a754-2248-470c-bcab-f5f100a78867 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 204 len: 0 microversion: 2.1 time: 0.115631 Aug 05 20:11:59.763829 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 503/1010] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:11:59 2022] DELETE /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:11:59.771991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:59.772645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:59.779493 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.780018 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.780464 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.781166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.781676 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.782095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.914285 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:59.919067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:59.919765 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:59.922284 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-621df5ef-20ba-4e63-a6b7-b7ab9bf1cfb7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1682 microversion: 2.1 time: 0.154195 Aug 05 20:11:59.922851 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 508/1011] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:59 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:59.928543 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.928543 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.928543 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.928543 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.928957 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.928957 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:00.067348 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:00.077327 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-48d77c1b-2b8f-4b7c-85bf-897925b8db60 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1362 microversion: 2.1 time: 0.162555 Aug 05 20:12:00.077907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 504/1012] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:59 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:00.944504 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:00.945123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:00.947147 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:00.947865 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=10 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:00.955223 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:00.955713 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:00.956196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:00.957141 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:00.957636 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:00.958142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:01.090470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:01.098199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-680f276c-c86a-44fa-8748-8cd3b82a9f9e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1682 microversion: 2.1 time: 0.157521 Aug 05 20:12:01.098775 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 509/1013] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:00 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:01.111958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:01.111958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:01.111958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:01.111958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:01.111958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:01.112690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:01.112690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:01.112690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:01.112690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:01.243506 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:01.251253 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fe76d368-f881-44b8-9236-c966fec59463 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1362 microversion: 2.1 time: 0.156149 Aug 05 20:12:01.251841 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 505/1014] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:01 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:02.122810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:02.123422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:02.129806 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-10b7d349-964a-4920-972f-4402f57c6139 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:02.130241 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:02.130393 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:02.130827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:02.131528 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:02.132009 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:02.132133 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-10b7d349-964a-4920-972f-4402f57c6139 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:02.132434 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:02.139418 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10b7d349-964a-4920-972f-4402f57c6139 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:02.139967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10b7d349-964a-4920-972f-4402f57c6139 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:02.140416 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10b7d349-964a-4920-972f-4402f57c6139 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:02.141124 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10b7d349-964a-4920-972f-4402f57c6139 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:02.141588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10b7d349-964a-4920-972f-4402f57c6139 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:02.142147 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-10b7d349-964a-4920-972f-4402f57c6139 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:02.219052 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-10b7d349-964a-4920-972f-4402f57c6139 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "POST /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/action" status: 202 len: 0 microversion: 2.1 time: 0.092904 Aug 05 20:12:02.223125 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 506/1015] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:12:02 2022] POST /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:12:02.228404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:02.229714 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:02.236378 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:02.236910 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:02.237355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:02.238103 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:02.238673 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:02.239562 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:02.273368 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:02.281040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-70727a13-168d-445c-85bc-779bdddd3219 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1682 microversion: 2.1 time: 0.162910 Aug 05 20:12:02.281592 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 510/1016] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:02 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:02.286332 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:02.286945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:02.293430 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:02.293917 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:02.294354 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:02.295053 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:02.295511 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:02.295966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:02.396150 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:02.404113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-868e7796-188f-473d-aea5-0cbda31dd472 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1753 microversion: 2.1 time: 0.179840 Aug 05 20:12:02.404688 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 507/1017] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:02 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:02.431022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:02.441382 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d071119b-eb22-4d00-af00-e5254a76a379 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1362 microversion: 2.1 time: 0.158770 Aug 05 20:12:02.441966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 511/1018] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:02 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:03.303176 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:03.303695 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:03.311120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.311609 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.312075 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.312773 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.313227 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.313688 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.430732 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:03.431358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:03.438198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.438878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.439311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.440067 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.440551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.440975 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.444888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:03.452679 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f21eb369-b022-4664-84b2-18bc9294ccf1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1682 microversion: 2.1 time: 0.153510 Aug 05 20:12:03.453446 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 508/1019] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:03 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:03.461827 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:03.462618 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:03.469592 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.470086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.470528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.471230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.471690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.472189 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.590055 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:03.598130 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c59f379b-5f98-40c2-9084-548275526f0b tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1753 microversion: 2.1 time: 0.175344 Aug 05 20:12:03.598960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 512/1020] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:03 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:03.610577 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:03.618700 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-53eda1a7-189d-4256-9fe7-9c41aeae2c94 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1547 microversion: 2.1 time: 0.160640 Aug 05 20:12:03.619426 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 509/1021] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:03 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:03.639208 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4abb88ad-3470-4b6f-bd4e-9153da8f325d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:03.639829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4abb88ad-3470-4b6f-bd4e-9153da8f325d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:03.645868 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4abb88ad-3470-4b6f-bd4e-9153da8f325d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.646359 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4abb88ad-3470-4b6f-bd4e-9153da8f325d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.646861 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4abb88ad-3470-4b6f-bd4e-9153da8f325d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.647555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4abb88ad-3470-4b6f-bd4e-9153da8f325d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.648032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4abb88ad-3470-4b6f-bd4e-9153da8f325d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.648453 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4abb88ad-3470-4b6f-bd4e-9153da8f325d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:04.064077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4abb88ad-3470-4b6f-bd4e-9153da8f325d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.429139 Aug 05 20:12:04.064708 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 513/1022] 10.222.0.95 () {58 vars in 1275 bytes} [Fri Aug 5 20:12:03 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/os-interface => generated 284 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:04.474248 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:04.475490 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:04.483214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:04.483716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:04.484192 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:04.484914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:04.485375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:04.486036 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:04.624586 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:04.625860 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:04.633717 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:04.634479 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:04.635814 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:04.637310 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:04.637939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:04.638700 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:04.762863 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:04.772370 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6433c207-9d77-4415-afa5-838305325fda tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1682 microversion: 2.1 time: 0.301939 Aug 05 20:12:04.773123 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 510/1023] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:04 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1682 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:04.961510 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:04.970610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6e7865bc-9d16-4794-9f74-0d1d0697b45e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1753 microversion: 2.1 time: 0.352199 Aug 05 20:12:04.971187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 514/1024] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:04 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1753 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:05.227886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-4afd342d-0de4-4859-ad84-5b8934485d35 req-101cb21a-6a79-427d-a220-dc3e33f8d3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101b95bd-3a7e-45bb-84b4-95f248da5670", "name": "network-vif-deleted", "tag": "69b936c8-4655-45e3-8477-1b9b83278ede"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:05.253065 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4afd342d-0de4-4859-ad84-5b8934485d35 req-101cb21a-6a79-427d-a220-dc3e33f8d3ad service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:05.253865 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4afd342d-0de4-4859-ad84-5b8934485d35 req-101cb21a-6a79-427d-a220-dc3e33f8d3ad service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:05.254475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4afd342d-0de4-4859-ad84-5b8934485d35 req-101cb21a-6a79-427d-a220-dc3e33f8d3ad service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:05.278023 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-4afd342d-0de4-4859-ad84-5b8934485d35 req-101cb21a-6a79-427d-a220-dc3e33f8d3ad service nova] Creating event network-vif-deleted:69b936c8-4655-45e3-8477-1b9b83278ede for instance 101b95bd-3a7e-45bb-84b4-95f248da5670 on hv-cinder-85221 Aug 05 20:12:05.285517 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-4afd342d-0de4-4859-ad84-5b8934485d35 req-101cb21a-6a79-427d-a220-dc3e33f8d3ad service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063552 Aug 05 20:12:05.287016 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 511/1025] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:05.460354 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-2cdeb682-6710-4318-94de-164087e23462 req-c5c0acf9-c6ca-4417-9ffb-180cb66a96fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd18fa6-7db0-4b85-a28a-3ddb1f058787", "tag": "1f42ea8e-3479-4841-ad1f-660c26f3b807"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:05.471220 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-2cdeb682-6710-4318-94de-164087e23462 req-c5c0acf9-c6ca-4417-9ffb-180cb66a96fc service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:05.471740 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-2cdeb682-6710-4318-94de-164087e23462 req-c5c0acf9-c6ca-4417-9ffb-180cb66a96fc service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:05.472651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-2cdeb682-6710-4318-94de-164087e23462 req-c5c0acf9-c6ca-4417-9ffb-180cb66a96fc service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:05.485449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-2cdeb682-6710-4318-94de-164087e23462 req-c5c0acf9-c6ca-4417-9ffb-180cb66a96fc service nova] Creating event network-changed:1f42ea8e-3479-4841-ad1f-660c26f3b807 for instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 on hv-cinder-85221 Aug 05 20:12:05.490830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-2cdeb682-6710-4318-94de-164087e23462 req-c5c0acf9-c6ca-4417-9ffb-180cb66a96fc service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034310 Aug 05 20:12:05.491650 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 515/1026] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:12:05.795399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:05.796811 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:05.803607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:05.804132 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:05.804642 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:05.805286 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:05.805746 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:05.806176 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:05.844276 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:05.844766 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:05.845200 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:05.845643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lazy-loading 'fault' on Instance uuid 101b95bd-3a7e-45bb-84b4-95f248da5670 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:12:05.888645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e79817ed9e40728f92a22053a24118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43323ff64b8843639e0428c69d5c71c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:05.897107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-85164b5d-ece1-4943-a075-4ded1ba550b1 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 200 len: 1331 microversion: 2.1 time: 0.105944 Aug 05 20:12:05.897920 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 512/1027] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:05 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:05.993276 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:05.995676 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:06.011134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:06.011286 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:06.011708 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:06.016630 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:06.017590 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:06.018223 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:06.344515 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:06.364070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-44c3ceb7-03f0-4b98-bd4f-efec01ac17e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.375058 Aug 05 20:12:06.365333 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 516/1028] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:05 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:06.920118 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:06.921193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:06.928163 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:06.928663 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:06.929111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:06.929810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:06.930265 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:06.930703 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:06.948144 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 HTTP/1.1 Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:12:06.950155 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:06.951722 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '101b95bd-3a7e-45bb-84b4-95f248da5670'} Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:06.952534 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:06.953768 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:06.955129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:06.955129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0e809d1e-d3ca-4ee1-b7dc-bf04318e7b44 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 404 len: 111 microversion: 2.1 time: 0.035982 Aug 05 20:12:06.955129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 513/1029] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:06 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:12:06.960928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-48c2786b-3614-4e52-963b-ddc89d76c036 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '.version_select at 0x7f5691e0d700>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:06.984021 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-48c2786b-3614-4e52-963b-ddc89d76c036 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-561030056" status: 202 len: 0 microversion: 2.1 time: 0.026897 Aug 05 20:12:06.984618 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 517/1030] 10.222.0.95 () {58 vars in 1218 bytes} [Fri Aug 5 20:12:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-561030056 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:12:07.388758 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:07.389625 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:07.395906 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:07.396423 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:07.396845 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:07.397549 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:07.398215 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:07.398651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:07.414733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:07.609531 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:07.617885 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7e2c14b3-e1ea-4215-b0e2-08aff8a97715 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.234728 Aug 05 20:12:07.618454 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 514/1031] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:07 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:08.640174 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:08.640820 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:08.646760 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:08.647237 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:08.647669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:08.648386 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:08.648837 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:08.649259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:08.798551 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:08.806370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d85ffda8-a962-4ff6-8c84-c6f754196eac tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.170699 Aug 05 20:12:08.807966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 518/1032] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:08 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:08.866204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:08.866689 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:08.873828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:08.874311 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:08.874749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:08.875442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:08.875929 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:08.876357 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:08.890085 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: DELETE /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 HTTP/1.1 Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:12:08.891629 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.893295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '101b95bd-3a7e-45bb-84b4-95f248da5670'} Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:08.894120 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.895399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.896772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:08.896772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bb65c6f0-643a-4b37-bdbf-f6835af04efc tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 404 len: 111 microversion: 2.1 time: 0.030650 Aug 05 20:12:08.896772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 515/1033] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:12:08 2022] DELETE /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:08.901789 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:08.902395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 101b95bd-3a7e-45bb-84b4-95f248da5670] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:08.908449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:08.908931 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:08.909368 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:08.910077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:08.910785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:08.911221 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:08.915300 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:08.925522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 HTTP/1.1 Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:12:08.927192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.928794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': '101b95bd-3a7e-45bb-84b4-95f248da5670'} Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:08.929673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. Aug 05 20:12:08.931203 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.933537 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance 101b95bd-3a7e-45bb-84b4-95f248da5670 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:08.933537 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5ec68d66-6bbe-45d1-a6ad-771ef8f362e7 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670" status: 404 len: 111 microversion: 2.1 time: 0.030666 Aug 05 20:12:08.933537 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 519/1034] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:08 2022] GET /compute/v2.1/servers/101b95bd-3a7e-45bb-84b4-95f248da5670 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:09.828990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:09.829634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:09.835643 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:09.836163 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:09.836610 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:09.837308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:09.838581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:09.839052 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:09.985712 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:09.993620 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1c88e2f2-55e5-40d6-9cd3-bd9191ea0e18 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.168504 Aug 05 20:12:09.994234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 516/1035] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:09 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:10.065466 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:10.065948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:10.073573 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:10.074063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:10.074500 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:10.075190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:10.075644 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:10.076103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:10.090303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 HTTP/1.1 Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:12:10.091801 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.093366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'ad207769-9bf5-4536-aa34-9551111c85e1'} Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:10.094229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.095649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.097108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:10.097108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b2fb1eb1-76ee-41f9-a281-2a4ecc1e6348 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 404 len: 111 microversion: 2.1 time: 0.031670 Aug 05 20:12:10.097108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 520/1036] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:12:10 2022] DELETE /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:10.101678 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:10.102520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: ad207769-9bf5-4536-aa34-9551111c85e1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:10.108911 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:10.109398 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:10.109837 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:10.110530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:10.110985 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:10.111431 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:10.125769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 HTTP/1.1 Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:12:10.127285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.128854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'ad207769-9bf5-4536-aa34-9551111c85e1'} Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:10.129759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. Aug 05 20:12:10.131161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.132520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance ad207769-9bf5-4536-aa34-9551111c85e1 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:10.132520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-90463fed-3a07-43d6-87e2-61ca0fe1e8b5 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1" status: 404 len: 111 microversion: 2.1 time: 0.030845 Aug 05 20:12:10.132520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 517/1037] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:10 2022] GET /compute/v2.1/servers/ad207769-9bf5-4536-aa34-9551111c85e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:10.137323 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:10.137823 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:10.143928 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:10.144417 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:10.144885 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:10.145576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:10.146032 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:10.146459 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:10.160199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 HTTP/1.1 Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:12:10.162020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.163591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'd7081e39-a5af-4ee0-89d2-90d44d2b7dd1'} Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:10.165107 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.167011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.168555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:10.168555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9b76bf9c-7d1c-4b00-a4db-38978ae3b84c tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 404 len: 111 microversion: 2.1 time: 0.030015 Aug 05 20:12:10.168555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 521/1038] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:12:10 2022] DELETE /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:10.176036 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:10.176660 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: d7081e39-a5af-4ee0-89d2-90d44d2b7dd1] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:10.182993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:10.183482 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:10.184075 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:10.184770 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:10.185224 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:10.185650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:10.199103 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 HTTP/1.1 Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:12:10.200659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.202285 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'd7081e39-a5af-4ee0-89d2-90d44d2b7dd1'} Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:10.203204 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. Aug 05 20:12:10.204743 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:10.206044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:10.206044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-905460f7-7d7d-4129-b6dd-5a2e48d09519 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1" status: 404 len: 111 microversion: 2.1 time: 0.031423 Aug 05 20:12:10.206044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 518/1039] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:10 2022] GET /compute/v2.1/servers/d7081e39-a5af-4ee0-89d2-90d44d2b7dd1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:11.015088 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:11.015699 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:11.021818 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:11.022302 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:11.022742 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:11.023432 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:11.023920 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:11.024353 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:11.167194 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:11.175317 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-31378259-b348-4a70-8193-638f1634fde7 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.164712 Aug 05 20:12:11.175901 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 522/1040] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:11 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:11.338012 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:11.338565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:11.345220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:11.345705 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:11.346146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:11.346849 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:11.347304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:11.347729 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:11.362214 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: DELETE /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec HTTP/1.1 Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:12:11.363794 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.365363 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '96010245-806a-4bf6-90fb-2a70ac2a17ec'} Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:11.366334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.367899 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.369533 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:11.369533 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3993da30-9f3e-43f8-80ea-142a538f6e53 tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "DELETE /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 404 len: 111 microversion: 2.1 time: 0.031002 Aug 05 20:12:11.369533 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 519/1041] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:12:11 2022] DELETE /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:11.374341 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:11.374953 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] [instance: 96010245-806a-4bf6-90fb-2a70ac2a17ec] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:11.380866 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:11.381355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:11.381791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:11.382483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:11.382939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:11.383369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:11.398558 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] HTTP exception thrown: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Request method failure captured: Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec HTTP/1.1 Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfFXO5lUEoKQeTlgVDUfc5Ws8wNBzT9nhupVQ7bOwJk1iJ63nEKz2sa8Fakyr8e81cJFc5WX8nrdfWv2XqJKeqE96eNIlBCk8wTAr58YbLZzTuC9YrGX2ctLO_Lz9_CK_haDbJ8YMfTvf90MLsp0JZLd5o5XwLKdx51XgtWJFCb2Bw Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:12:11.400103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/43323ff64b8843639e0428c69d5c71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 43323ff64b8843639e0428c69d5c71c1 Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498548929 Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 67e79817ed9e40728f92a22053a24118 Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeNegativeTest-1498548929-project Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.401897 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': '96010245-806a-4bf6-90fb-2a70ac2a17ec'} Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:11.402825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. Aug 05 20:12:11.405381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:11.406698 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] Returning 404 to user: Instance 96010245-806a-4bf6-90fb-2a70ac2a17ec could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:11.406698 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d2776158-44d6-4545-a3c1-158a467aba3e tempest-AttachVolumeNegativeTest-1498548929 tempest-AttachVolumeNegativeTest-1498548929-project] 10.222.0.95 "GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec" status: 404 len: 111 microversion: 2.1 time: 0.031604 Aug 05 20:12:11.406698 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 523/1042] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:11 2022] GET /compute/v2.1/servers/96010245-806a-4bf6-90fb-2a70ac2a17ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:12.196833 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:12.197532 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:12.204360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.204848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.205281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:12.205969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.206419 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.206859 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:12.359736 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:12.368341 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9ec3c001-f1ed-45d6-957d-15da7f2448b0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.175341 Aug 05 20:12:12.368907 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 520/1043] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:12 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:12.555726 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b4feca7f-2ab4-4385-a524-f5fa34492e2a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:12.558276 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b4feca7f-2ab4-4385-a524-f5fa34492e2a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:12.571667 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4feca7f-2ab4-4385-a524-f5fa34492e2a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.572269 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4feca7f-2ab4-4385-a524-f5fa34492e2a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.572782 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4feca7f-2ab4-4385-a524-f5fa34492e2a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:12.575296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4feca7f-2ab4-4385-a524-f5fa34492e2a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.575296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4feca7f-2ab4-4385-a524-f5fa34492e2a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.575296 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b4feca7f-2ab4-4385-a524-f5fa34492e2a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:12.608708 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b4feca7f-2ab4-4385-a524-f5fa34492e2a tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057001 Aug 05 20:12:12.609373 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 524/1044] 10.222.0.95 () {60 vars in 1343 bytes} [Fri Aug 5 20:12:12 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:12.677845 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:12.678345 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:12.684777 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.685271 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.685716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:12.686420 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.686875 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.687299 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:12.712729 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:12:12.794584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-de0368c3-ac57-4c5f-bedb-0848b88d85f5 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "DELETE /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 204 len: 0 microversion: 2.20 time: 0.121215 Aug 05 20:12:12.795167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 521/1045] 10.222.0.95 () {60 vars in 1280 bytes} [Fri Aug 5 20:12:12 2022] DELETE /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:12:12.803873 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:12.804804 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:12.810882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.811441 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.812015 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:12.812774 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.813400 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.813823 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:13.238523 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:13.250648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:13.250648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:13.250648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f5ee3ff0-a345-4dfa-8412-b7027f271092 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.450095 Aug 05 20:12:13.251060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 525/1046] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:12:12 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:12:13.391599 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:13.392454 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:13.398806 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:13.399291 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:13.399904 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:13.400602 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:13.401058 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:13.401483 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:13.667977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:13.680987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-d44c0e49-f36a-48ad-862e-ff51893516e0 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.293930 Aug 05 20:12:13.691212 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 522/1047] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:13 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:14.273060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:14.273905 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:14.280445 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:14.280932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:14.281483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:14.282189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:14.282648 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:14.283075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:14.430624 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:14.439669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:14.441483 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:14.442825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a880ac16-63df-42c1-ab72-981a07c148cf tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1723 microversion: 2.20 time: 0.173554 Aug 05 20:12:14.452238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 526/1048] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:12:14 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:12:14.702568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:14.703403 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:14.714881 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:14.718531 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:14.719054 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:14.719888 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:14.720593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:14.721312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:15.081030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:15.096054 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-cf2acb8a-d7c8-4519-8c55-11e5ad7b962d tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.397222 Aug 05 20:12:15.098262 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 523/1049] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:14 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:15.467153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:15.467769 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:15.476568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:15.477389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:15.477939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:15.479377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:15.481655 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:15.482227 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:15.500352 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-b1a9ab9a-290c-4cb1-b912-ecf5cc8c362b req-f4deef5a-f262-47fa-bf91-016c21bede46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9126b58-ee6c-4974-ba02-f2d0384bbb90", "name": "network-vif-deleted", "tag": "7ee1d147-d81b-4d46-a28d-f1a0289d9691"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:15.510774 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-b1a9ab9a-290c-4cb1-b912-ecf5cc8c362b req-f4deef5a-f262-47fa-bf91-016c21bede46 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:15.512478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-b1a9ab9a-290c-4cb1-b912-ecf5cc8c362b req-f4deef5a-f262-47fa-bf91-016c21bede46 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:15.513024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-b1a9ab9a-290c-4cb1-b912-ecf5cc8c362b req-f4deef5a-f262-47fa-bf91-016c21bede46 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:15.525905 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-b1a9ab9a-290c-4cb1-b912-ecf5cc8c362b req-f4deef5a-f262-47fa-bf91-016c21bede46 service nova] Creating event network-vif-deleted:7ee1d147-d81b-4d46-a28d-f1a0289d9691 for instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 on hv-cinder-85221 Aug 05 20:12:15.533416 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-b1a9ab9a-290c-4cb1-b912-ecf5cc8c362b req-f4deef5a-f262-47fa-bf91-016c21bede46 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036834 Aug 05 20:12:15.534122 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 524/1050] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:12:15.633377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:15.644342 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:15.657575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf898f67aca42db8d51924ca4d8a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520f87324854dd0a5d0c9e10caa7fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:15.660697 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3ed346e4-d88e-4f9d-8960-c8fd20e6ae4b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 200 len: 1655 microversion: 2.20 time: 0.197307 Aug 05 20:12:15.675806 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 527/1051] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:12:15 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 1655 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:12:16.119754 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:16.121146 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:16.127090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:16.127594 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:16.128046 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:16.128742 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:16.129366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:16.129962 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:16.316524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:16.325721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-52d065a0-d990-4ea8-9c88-691a8047ec3c tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.210593 Aug 05 20:12:16.326711 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 525/1052] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:16 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:16.685473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:16.686321 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:16.693819 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:16.694619 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:16.694959 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:16.695664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:16.696143 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:16.696564 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:16.712546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] HTTP exception thrown: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Request method failure captured: Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 HTTP/1.1 Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfBbaLKnEyeIqfaQFeAKM7uaQD5e4OM5pXxDnbyyu3q1UK6In83d-PUeoi7F4Or8Nd6giBymxTdbEqeMHuVuwtRH71y41Z03oVY0N9SUPKwfZ3BlqkxzjwQcrJZFcTJqzCUadF4vhs9asB2-8xsHxFDgfxrxYPHpWfedHwHNcqnOS8 Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:12:16.714153 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: edf898f67aca42db8d51924ca4d8a300 Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:16.715679 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'f9126b58-ee6c-4974-ba02-f2d0384bbb90'} Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:16.716476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:16.717787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:16.718921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Returning 404 to user: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:16.718921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2712be16-5b6e-41e5-a027-0b6b37ae01a4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 404 len: 111 microversion: 2.20 time: 0.035016 Aug 05 20:12:16.718921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 528/1053] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:12:16 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:12:16.725735 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fd4dc03b-8a3d-4606-9e2d-cb730347a4ba tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '.version_select at 0x7f5691de30d0>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:16.748926 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fd4dc03b-8a3d-4606-9e2d-cb730347a4ba tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-658636166" status: 204 len: 0 microversion: 2.20 time: 0.027869 Aug 05 20:12:16.749604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 526/1054] 10.222.0.95 () {60 vars in 1259 bytes} [Fri Aug 5 20:12:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-658636166 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:12:17.348002 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:17.348626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:17.357561 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:17.358067 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:17.358514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:17.359263 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:17.359966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:17.360576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:17.575191 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:17.583321 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5f01d7fd-44e6-454a-b245-5a8c885e4639 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.239361 Aug 05 20:12:17.583911 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 529/1055] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:17 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:18.594842 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:18.595396 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:18.597332 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:18.603333 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:18.603924 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:18.604287 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:18.605556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:18.606018 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:18.606437 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:18.608455 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:18.609852 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:18.623858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:18.624370 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:18.631893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:18.632559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:18.633218 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:18.633658 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:18.656292 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] HTTP exception thrown: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Request method failure captured: Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: DELETE /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 HTTP/1.1 Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfBbaLKnEyeIqfaQFeAKM7uaQD5e4OM5pXxDnbyyu3q1UK6In83d-PUeoi7F4Or8Nd6giBymxTdbEqeMHuVuwtRH71y41Z03oVY0N9SUPKwfZ3BlqkxzjwQcrJZFcTJqzCUadF4vhs9asB2-8xsHxFDgfxrxYPHpWfedHwHNcqnOS8 Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:12:18.658043 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: edf898f67aca42db8d51924ca4d8a300 Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.659402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'f9126b58-ee6c-4974-ba02-f2d0384bbb90'} Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:18.660823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.663939 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.665685 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Returning 404 to user: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:18.665685 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-df5392a1-429b-43b9-803b-5ce60073245b tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "DELETE /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 404 len: 111 microversion: 2.20 time: 0.070546 Aug 05 20:12:18.665685 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 527/1056] 10.222.0.95 () {60 vars in 1280 bytes} [Fri Aug 5 20:12:18 2022] DELETE /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:12:18.669965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:18.670659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: f9126b58-ee6c-4974-ba02-f2d0384bbb90] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:18.676954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:18.677514 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:18.678024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:18.678791 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:18.679335 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:18.679858 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:18.697004 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] HTTP exception thrown: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Request method failure captured: Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 HTTP/1.1 Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XfBbaLKnEyeIqfaQFeAKM7uaQD5e4OM5pXxDnbyyu3q1UK6In83d-PUeoi7F4Or8Nd6giBymxTdbEqeMHuVuwtRH71y41Z03oVY0N9SUPKwfZ3BlqkxzjwQcrJZFcTJqzCUadF4vhs9asB2-8xsHxFDgfxrxYPHpWfedHwHNcqnOS8 Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:12:18.698854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: edf898f67aca42db8d51924ca4d8a300 Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.700304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'f9126b58-ee6c-4974-ba02-f2d0384bbb90'} Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:18.701040 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. Aug 05 20:12:18.702217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:12:18.703369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Returning 404 to user: Instance f9126b58-ee6c-4974-ba02-f2d0384bbb90 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:18.703369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b836d404-e01a-403d-911c-c0c291f063cc tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90" status: 404 len: 111 microversion: 2.20 time: 0.036132 Aug 05 20:12:18.703369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 528/1057] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:12:18 2022] GET /compute/v2.1/servers/f9126b58-ee6c-4974-ba02-f2d0384bbb90 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:12:18.806188 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:18.821466 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1d6bd148-93f6-4ad2-8748-653db8155c61 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.217526 Aug 05 20:12:18.821466 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 530/1058] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:18 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:19.841918 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:19.842942 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:19.851266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:19.851761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:19.852388 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:19.853411 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:19.854023 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:19.855147 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:19.864429 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:19.865918 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:19.875339 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:19.876182 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:19.876627 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:19.877593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:19.878052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:19.878937 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:19.896723 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] HTTP exception thrown: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Request method failure captured: Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca HTTP/1.1 Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfBbaLKnEyeIqfaQFeAKM7uaQD5e4OM5pXxDnbyyu3q1UK6In83d-PUeoi7F4Or8Nd6giBymxTdbEqeMHuVuwtRH71y41Z03oVY0N9SUPKwfZ3BlqkxzjwQcrJZFcTJqzCUadF4vhs9asB2-8xsHxFDgfxrxYPHpWfedHwHNcqnOS8 Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:12:19.898377 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: edf898f67aca42db8d51924ca4d8a300 Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.900070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'a49e6225-f22b-44fc-ad77-be5500dd95ca'} Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:19.900939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.903100 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.905268 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Returning 404 to user: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:19.905268 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d63de12b-35b5-4bf6-b8c6-01e0af88146c tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "DELETE /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 404 len: 111 microversion: 2.20 time: 0.039682 Aug 05 20:12:19.905268 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 531/1059] 10.222.0.95 () {60 vars in 1280 bytes} [Fri Aug 5 20:12:19 2022] DELETE /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:12:19.915255 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:19.915255 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] [instance: a49e6225-f22b-44fc-ad77-be5500dd95ca] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:19.920414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:19.921066 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:19.921827 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:19.922724 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:19.923199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:19.923622 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:19.938898 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] HTTP exception thrown: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Request method failure captured: Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca HTTP/1.1 Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XfBbaLKnEyeIqfaQFeAKM7uaQD5e4OM5pXxDnbyyu3q1UK6In83d-PUeoi7F4Or8Nd6giBymxTdbEqeMHuVuwtRH71y41Z03oVY0N9SUPKwfZ3BlqkxzjwQcrJZFcTJqzCUadF4vhs9asB2-8xsHxFDgfxrxYPHpWfedHwHNcqnOS8 Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:12:19.940485 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0520f87324854dd0a5d0c9e10caa7fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 0520f87324854dd0a5d0c9e10caa7fda Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1058999308 Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: edf898f67aca42db8d51924ca4d8a300 Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1058999308-project Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.942161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'a49e6225-f22b-44fc-ad77-be5500dd95ca'} Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:19.943038 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. Aug 05 20:12:19.944383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:12:19.946293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] Returning 404 to user: Instance a49e6225-f22b-44fc-ad77-be5500dd95ca could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:19.947142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-bb88efa9-935d-4ffe-a469-9f7e5ce210f4 tempest-AttachVolumeShelveTestJSON-1058999308 tempest-AttachVolumeShelveTestJSON-1058999308-project] 10.222.0.95 "GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca" status: 404 len: 111 microversion: 2.20 time: 0.039164 Aug 05 20:12:19.947705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 532/1060] 10.222.0.95 () {60 vars in 1277 bytes} [Fri Aug 5 20:12:19 2022] GET /compute/v2.1/servers/a49e6225-f22b-44fc-ad77-be5500dd95ca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:12:20.036372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:20.046592 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-dbf2cffe-353a-4344-aef0-ecbcab033d9f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.209364 Aug 05 20:12:20.047928 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 529/1061] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:19 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:21.068757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:21.069470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:21.079719 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:21.080848 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:21.081512 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:21.083438 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:21.084337 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:21.084617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:21.368247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:21.376988 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a3598db2-fe8b-458a-acc1-e45fa7752b64 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1758 microversion: 2.1 time: 0.312311 Aug 05 20:12:21.377570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 533/1062] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:21 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1758 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:22.403828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:22.404987 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:22.414912 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:22.415590 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:22.431476 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:22.432439 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:22.433149 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:22.433649 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:22.597457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:22.606585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5284ba51-a52f-4324-bb9f-c2ecde171829 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1761 microversion: 2.1 time: 0.207788 Aug 05 20:12:22.607166 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 530/1063] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:22 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1761 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:57.785135 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0965999e-bee9-4788-9dba-f557a004ed31 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:57.785707 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0965999e-bee9-4788-9dba-f557a004ed31 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:57.788798 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:57.788798 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=60 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:57.793861 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0965999e-bee9-4788-9dba-f557a004ed31 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:57.794357 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0965999e-bee9-4788-9dba-f557a004ed31 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:57.794795 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0965999e-bee9-4788-9dba-f557a004ed31 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:57.795503 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0965999e-bee9-4788-9dba-f557a004ed31 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:57.795990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0965999e-bee9-4788-9dba-f557a004ed31 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:57.796422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0965999e-bee9-4788-9dba-f557a004ed31 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:57.821505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0965999e-bee9-4788-9dba-f557a004ed31 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/ips" status: 200 len: 145 microversion: 2.1 time: 0.041238 Aug 05 20:12:57.823873 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 534/1064] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:12:57 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:00.431583 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-888edf37-e2c3-4f08-a321-29577b65fa86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de6171c9-3f00-4f98-ac32-e0ae2d8e6d06"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:00.434203 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-888edf37-e2c3-4f08-a321-29577b65fa86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:00.436334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=7 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:00.437128 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:00.442960 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888edf37-e2c3-4f08-a321-29577b65fa86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:00.443096 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888edf37-e2c3-4f08-a321-29577b65fa86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:00.443436 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888edf37-e2c3-4f08-a321-29577b65fa86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:00.444313 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888edf37-e2c3-4f08-a321-29577b65fa86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:00.444772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888edf37-e2c3-4f08-a321-29577b65fa86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:00.445199 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-888edf37-e2c3-4f08-a321-29577b65fa86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:00.774881 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-888edf37-e2c3-4f08-a321-29577b65fa86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347645 Aug 05 20:13:00.775889 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 531/1065] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:13:00 2022] POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:03.977017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:03.978158 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:03.981312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-cd3c5474-d776-485f-babd-564785345a81 req-877810d6-9262-4ec1-9215-c608ca73b85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e532dd-0c95-4d65-9f31-a698bdfdf52f", "tag": "1a52d740-fd7b-4b85-b351-dfbb3497a9af"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:03.989817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:03.990967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:03.991997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:03.993492 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:03.994317 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:03.996366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:03.998708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-cd3c5474-d776-485f-babd-564785345a81 req-877810d6-9262-4ec1-9215-c608ca73b85e service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:03.999512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-cd3c5474-d776-485f-babd-564785345a81 req-877810d6-9262-4ec1-9215-c608ca73b85e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:04.000262 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-cd3c5474-d776-485f-babd-564785345a81 req-877810d6-9262-4ec1-9215-c608ca73b85e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:04.024694 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-cd3c5474-d776-485f-babd-564785345a81 req-877810d6-9262-4ec1-9215-c608ca73b85e service nova] Creating event network-changed:1a52d740-fd7b-4b85-b351-dfbb3497a9af for instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f on hv-cinder-85221 Aug 05 20:13:04.032725 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Going to try to terminate instance {{(pid=118174) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:13:04.033892 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-cd3c5474-d776-485f-babd-564785345a81 req-877810d6-9262-4ec1-9215-c608ca73b85e service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059753 Aug 05 20:13:04.035382 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 532/1066] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:04.118232 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-55221ab1-bf45-4104-8ec9-a9b317e5ab35 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "DELETE /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 204 len: 0 microversion: 2.1 time: 0.147650 Aug 05 20:13:04.121884 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 535/1067] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:13:03 2022] DELETE /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:13:04.128258 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:04.128965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:04.135229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:04.135715 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:04.136190 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:04.136886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:04.137342 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:04.137769 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:04.285361 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:04.293161 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e4be8b69-3a06-4cdf-b758-3c5083d9e7c0 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.169710 Aug 05 20:13:04.293740 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 533/1068] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:04 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:05.316414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:05.317143 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:05.323504 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:05.324030 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:05.324470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:05.325161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:05.325617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:05.326042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:05.461803 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:05.470217 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b70418e0-5b1f-4005-a938-54801da2c13c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.157897 Aug 05 20:13:05.470604 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 536/1069] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:05 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:06.490620 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:06.491229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:06.497976 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:06.498457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:06.498898 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:06.499582 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:06.500063 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:06.500501 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:06.637927 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:06.646565 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b19dbb32-1f7a-4c82-af33-4d1b42351c0c tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.159809 Aug 05 20:13:06.647219 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 534/1070] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:06 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:07.668236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:07.668853 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:07.676860 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:07.677357 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:07.677800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:07.678512 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:07.678971 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:07.679395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:07.834467 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:07.842518 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-09ad0af3-804e-478d-83ca-2d7f32bbd7ed tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.178215 Aug 05 20:13:07.843196 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 537/1071] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:07 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:08.868674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:08.869925 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:08.877648 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:08.878147 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:08.878588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:08.887850 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-573517496"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:08.888334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:08.895803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:08.896314 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:08.896737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:08.896880 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:08.897643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:08.898289 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:08.899535 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:08.900189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:08.900788 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:09.100194 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:09.143010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4a505f7f-15a1-4148-b333-2504141bae19 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1568 microversion: 2.1 time: 0.278227 Aug 05 20:13:09.161995 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 535/1072] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:08 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:09.332999 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.network.security_group_api [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Removing security group 26a225f3-8376-4262-9cb5-1989ad9461d5 from port ccf2670a-c2a3-4a62-ad5a-290565f526fe Aug 05 20:13:09.579587 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7fae8c7f-c4e5-4d7e-bd82-1983cbb64b57 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:09.587057 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7fae8c7f-c4e5-4d7e-bd82-1983cbb64b57 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:09.587896 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7fae8c7f-c4e5-4d7e-bd82-1983cbb64b57 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:09.588600 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7fae8c7f-c4e5-4d7e-bd82-1983cbb64b57 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:09.688352 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7fae8c7f-c4e5-4d7e-bd82-1983cbb64b57 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Going to try to stop instance {{(pid=118175) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 20:13:09.761537 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7fae8c7f-c4e5-4d7e-bd82-1983cbb64b57 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/action" status: 202 len: 0 microversion: 2.1 time: 0.186287 Aug 05 20:13:09.762294 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 536/1073] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:13:09 2022] POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:13:09.771045 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:09.772024 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:09.778623 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:09.779297 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:09.779990 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:09.781005 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:09.781628 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:09.782412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:09.998205 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:10.008490 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8e109f2f-8ea5-4bed-a6cd-547765adbb59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.242188 Aug 05 20:13:10.009842 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 537/1074] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:09 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:10.026991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0eb456df-315e-4b7d-b624-064df6f979e8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "POST /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/action" status: 202 len: 0 microversion: 2.1 time: 1.143518 Aug 05 20:13:10.027643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 538/1075] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:13:08 2022] POST /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/action => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:13:10.069259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-4f04420d-b4e1-4447-955b-5a415f92108f req-b9538965-d37d-46d1-897e-7f7c03c570db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94cc1d6-32e5-4c24-8e26-e811d5a25389", "tag": "ccf2670a-c2a3-4a62-ad5a-290565f526fe"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:10.097702 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4f04420d-b4e1-4447-955b-5a415f92108f req-b9538965-d37d-46d1-897e-7f7c03c570db service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:10.098667 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4f04420d-b4e1-4447-955b-5a415f92108f req-b9538965-d37d-46d1-897e-7f7c03c570db service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:10.099336 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-4f04420d-b4e1-4447-955b-5a415f92108f req-b9538965-d37d-46d1-897e-7f7c03c570db service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:10.113424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-4f04420d-b4e1-4447-955b-5a415f92108f req-b9538965-d37d-46d1-897e-7f7c03c570db service nova] Creating event network-changed:ccf2670a-c2a3-4a62-ad5a-290565f526fe for instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 on hv-cinder-85221 Aug 05 20:13:10.122838 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-4f04420d-b4e1-4447-955b-5a415f92108f req-b9538965-d37d-46d1-897e-7f7c03c570db service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057742 Aug 05 20:13:10.124334 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 538/1076] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:10.197189 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:10.198614 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:10.213103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:10.214363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:10.215720 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:10.218673 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:10.222597 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:10.223334 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:10.425119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:10.435200 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7789b2aa-8eb1-411f-b3a0-6392e9361484 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1219 microversion: 2.1 time: 0.253303 Aug 05 20:13:10.437677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 539/1077] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:10 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1219 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:11.033650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:11.035498 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:11.052080 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.055263 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.056057 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.057087 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.057720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.058325 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.405713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:11.414837 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-e3671a37-38eb-48d2-8519-f90cefbe4aab tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.387823 Aug 05 20:13:11.416440 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 539/1078] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:11 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:11.462448 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:11.463720 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:11.470720 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.471393 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.471940 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.472716 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.473246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.473745 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.517583 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.517992 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.518440 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.518881 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lazy-loading 'fault' on Instance uuid e6e532dd-0c95-4d65-9f31-a698bdfdf52f {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:13:11.575079 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ccb4c3326c47a3ab69bbf5830ab1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13d23d483b47f6b8f45c9aedea072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:11.583664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cf35169c-2bda-4b18-9e25-6928692a6e49 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 200 len: 1224 microversion: 2.1 time: 0.124951 Aug 05 20:13:11.600490 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 540/1079] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:11 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:11.853982 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-4361e826-7a6c-491b-92f6-4a8a51cd91f7 req-f0c42457-de0b-49d7-8caa-27923bac0cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94cc1d6-32e5-4c24-8e26-e811d5a25389", "tag": "ccf2670a-c2a3-4a62-ad5a-290565f526fe"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:11.855010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:11.856302 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:11.864119 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-4361e826-7a6c-491b-92f6-4a8a51cd91f7 req-f0c42457-de0b-49d7-8caa-27923bac0cf8 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.864777 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-4361e826-7a6c-491b-92f6-4a8a51cd91f7 req-f0c42457-de0b-49d7-8caa-27923bac0cf8 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.865366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-4361e826-7a6c-491b-92f6-4a8a51cd91f7 req-f0c42457-de0b-49d7-8caa-27923bac0cf8 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.865966 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.866710 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.867538 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.869132 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.869869 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.870651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.877743 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-4361e826-7a6c-491b-92f6-4a8a51cd91f7 req-f0c42457-de0b-49d7-8caa-27923bac0cf8 service nova] Creating event network-changed:ccf2670a-c2a3-4a62-ad5a-290565f526fe for instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 on hv-cinder-85221 Aug 05 20:13:11.884288 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-4361e826-7a6c-491b-92f6-4a8a51cd91f7 req-f0c42457-de0b-49d7-8caa-27923bac0cf8 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033667 Aug 05 20:13:11.888611 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 541/1080] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:11.971248 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.objects.instance [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lazy-loading 'services' on Instance uuid c94cc1d6-32e5-4c24-8e26-e811d5a25389 {{(pid=118175) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:13:12.056810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7fd3ee67-ee85-4a25-baf0-d3ebcc6cf6cb tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "DELETE /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments/0e700cad-aa05-432b-a96d-539fffb975b1" status: 202 len: 0 microversion: 2.1 time: 0.208350 Aug 05 20:13:12.060823 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 540/1081] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:13:11 2022] DELETE /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments/0e700cad-aa05-432b-a96d-539fffb975b1 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:13:12.068073 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-aa5bdc98-44ee-46ab-869a-961d0e273f8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:12.070755 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-aa5bdc98-44ee-46ab-869a-961d0e273f8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:12.079076 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa5bdc98-44ee-46ab-869a-961d0e273f8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:12.079968 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa5bdc98-44ee-46ab-869a-961d0e273f8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:12.080687 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa5bdc98-44ee-46ab-869a-961d0e273f8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:12.081473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa5bdc98-44ee-46ab-869a-961d0e273f8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:12.081942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa5bdc98-44ee-46ab-869a-961d0e273f8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:12.082375 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-aa5bdc98-44ee-46ab-869a-961d0e273f8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:12.121336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-aa5bdc98-44ee-46ab-869a-961d0e273f8f tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059471 Aug 05 20:13:12.122495 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 542/1082] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:13:12 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:13:12.149134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-d412c654-3cc6-420a-96aa-7880800a9afd req-1419a84f-d743-48ce-b641-3ccc980c4f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e532dd-0c95-4d65-9f31-a698bdfdf52f", "name": "network-vif-deleted", "tag": "1a52d740-fd7b-4b85-b351-dfbb3497a9af"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:12.173186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-d412c654-3cc6-420a-96aa-7880800a9afd req-1419a84f-d743-48ce-b641-3ccc980c4f9a service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:12.178639 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-d412c654-3cc6-420a-96aa-7880800a9afd req-1419a84f-d743-48ce-b641-3ccc980c4f9a service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:12.179816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-d412c654-3cc6-420a-96aa-7880800a9afd req-1419a84f-d743-48ce-b641-3ccc980c4f9a service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:12.201061 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-d412c654-3cc6-420a-96aa-7880800a9afd req-1419a84f-d743-48ce-b641-3ccc980c4f9a service nova] Creating event network-vif-deleted:1a52d740-fd7b-4b85-b351-dfbb3497a9af for instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f on hv-cinder-85221 Aug 05 20:13:12.207523 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-d412c654-3cc6-420a-96aa-7880800a9afd req-1419a84f-d743-48ce-b641-3ccc980c4f9a service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065646 Aug 05 20:13:12.209007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 541/1083] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:12.439451 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:12.440275 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:12.448299 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:12.448874 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:12.449378 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:12.450081 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:12.450534 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:12.450959 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:12.608681 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:12.611051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] [instance: e6e532dd-0c95-4d65-9f31-a698bdfdf52f] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:12.621442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:12.622443 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:12.623139 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:12.624279 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:12.624965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:12.625878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:12.675222 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] HTTP exception thrown: Instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f could not be found. Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Request method failure captured: Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f HTTP/1.1 Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XhVgboPLAUQx337LmRsR_qukWbVyKOr5fbFzM9sHDkKMrs49nVWRL6EAIhZgcNsAXfmzyg_EWwexyoMo2qduZzkAVpKbJ-tq6x4j9ad-jsVkbwenbGoupPieUg-Ar6LMPDLCltpDsn7eckSM03AIuuD5fkfycVfXPXwBBzU4Am4g-g Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: ec13d23d483b47f6b8f45c9aedea072a Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-TestShelveInstance-1542042826 Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:13:12.679391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/ec13d23d483b47f6b8f45c9aedea072a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_ec13d23d483b47f6b8f45c9aedea072a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/ec13d23d483b47f6b8f45c9aedea072a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/ec13d23d483b47f6b8f45c9aedea072a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-TestShelveInstance-1542042826 Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: ec13d23d483b47f6b8f45c9aedea072a Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-TestShelveInstance-1542042826 Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-TestShelveInstance-1542042826-project Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 69ccb4c3326c47a3ab69bbf5830ab1ef Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-TestShelveInstance-1542042826-project Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f could not be found. Aug 05 20:13:12.681230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'e6e532dd-0c95-4d65-9f31-a698bdfdf52f'} Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f could not be found. Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:13:12.682068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f could not be found. Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f could not be found. Aug 05 20:13:12.683572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:12.685869 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Returning 404 to user: Instance e6e532dd-0c95-4d65-9f31-a698bdfdf52f could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:13:12.690632 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-38510629-b42f-45bc-bd8e-6368129e7376 tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f" status: 404 len: 111 microversion: 2.1 time: 0.085941 Aug 05 20:13:12.696959 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 542/1084] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:12 2022] GET /compute/v2.1/servers/e6e532dd-0c95-4d65-9f31-a698bdfdf52f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:13:12.948680 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-56e831c4-dc1e-4aef-846e-afc677a199bf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] Calling method '.version_select at 0x7f5691c305e0>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:13.002514 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-56e831c4-dc1e-4aef-846e-afc677a199bf tempest-TestShelveInstance-1542042826 tempest-TestShelveInstance-1542042826-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2140324307" status: 202 len: 0 microversion: 2.1 time: 0.057820 Aug 05 20:13:13.003367 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 543/1085] 10.222.0.95 () {58 vars in 1254 bytes} [Fri Aug 5 20:13:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2140324307 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:13:13.101259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:13.118104 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f7dac66d-4d92-4ad1-bf3e-4bb6929d32c7 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.684925 Aug 05 20:13:13.119080 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 543/1086] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:12 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:13.139506 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8f90d6ef-127f-4f44-8da8-8d8ad19fe5b8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:13.143378 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-8f90d6ef-127f-4f44-8da8-8d8ad19fe5b8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:13.151662 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8f90d6ef-127f-4f44-8da8-8d8ad19fe5b8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:13.152197 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8f90d6ef-127f-4f44-8da8-8d8ad19fe5b8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:13.152633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8f90d6ef-127f-4f44-8da8-8d8ad19fe5b8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:13.153340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8f90d6ef-127f-4f44-8da8-8d8ad19fe5b8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:13.153809 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8f90d6ef-127f-4f44-8da8-8d8ad19fe5b8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:13.154237 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-8f90d6ef-127f-4f44-8da8-8d8ad19fe5b8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:13.205601 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8f90d6ef-127f-4f44-8da8-8d8ad19fe5b8 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074176 Aug 05 20:13:13.209055 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 544/1087] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:13:13 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:13:13.221559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:13.222059 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:13.229475 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:13.229858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:13.230298 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:13.231201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:13.231664 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:13.232121 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:13.323652 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] HTTP exception thrown: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 is not attached to volume 0e700cad-aa05-432b-a96d-539fffb975b1 Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Request method failure captured: Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments/0e700cad-aa05-432b-a96d-539fffb975b1 HTTP/1.1 Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XknHtfwQzBrMdrJItdEv7mlDTDWd2-707FEqPZyK_HF8b82mH0r1ayCyhlU2nraT9X2-DwpAMZjrglTfYRULV0tAJO9gCxdmyOw9d20dEcdUTmCD-3DleDgYnDwcotIoyezekfhglVZiLffHmhwRE3-LK4niDfp2J4VwhyCZ1oo9h8 Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: c8dacae2d58843f2b1b8b532759b83ee Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-TestMinimumBasicScenario-1263328437 Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:13:13.331134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/c8dacae2d58843f2b1b8b532759b83ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_c8dacae2d58843f2b1b8b532759b83ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/c8dacae2d58843f2b1b8b532759b83ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/c8dacae2d58843f2b1b8b532759b83ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-TestMinimumBasicScenario-1263328437 Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: c8dacae2d58843f2b1b8b532759b83ee Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1263328437 Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-TestMinimumBasicScenario-1263328437-project Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 44c083ae1c5a4444a55ecb26cfdd58ca Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-TestMinimumBasicScenario-1263328437-project Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:13:13.332514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 is not attached to volume 0e700cad-aa05-432b-a96d-539fffb975b1 Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'server_id': 'c94cc1d6-32e5-4c24-8e26-e811d5a25389', 'id': '0e700cad-aa05-432b-a96d-539fffb975b1'} Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0e700cad-aa05-432b-a96d-539fffb975b1. Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:13:13.333236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 is not attached to volume 0e700cad-aa05-432b-a96d-539fffb975b1 Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 is not attached to volume 0e700cad-aa05-432b-a96d-539fffb975b1 Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:13:13.334477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Returning 404 to user: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 is not attached to volume 0e700cad-aa05-432b-a96d-539fffb975b1 {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:13:13.335431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-cc5977bc-fc44-4fce-b9ee-250e4d1d8051 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "DELETE /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments/0e700cad-aa05-432b-a96d-539fffb975b1" status: 404 len: 154 microversion: 2.1 time: 0.116797 Aug 05 20:13:13.335431 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 544/1088] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:13:13 2022] DELETE /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389/os-volume_attachments/0e700cad-aa05-432b-a96d-539fffb975b1 => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:13:14.142994 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:14.144308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:14.151221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.151716 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.152295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.152976 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.153467 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.154023 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.358671 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:14.368882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bd16aa99-b8be-4f7d-af80-a642a5858878 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.231334 Aug 05 20:13:14.369458 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 545/1089] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:14 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:14.553826 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:14.554341 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:14.561202 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.561693 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.562330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.564063 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.564741 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.565179 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.607640 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Going to try to terminate instance {{(pid=118174) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:13:14.792470 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6635b4fe-5071-48e9-b6a2-7b186e21d78e tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "DELETE /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 204 len: 0 microversion: 2.1 time: 0.243932 Aug 05 20:13:14.794593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 545/1090] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:13:14 2022] DELETE /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:13:14.811512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:14.812723 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:14.836412 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.836827 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.837260 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.840579 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.843761 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.847854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:15.314462 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:15.322753 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-50eff1ad-8a7d-4de4-8462-c187bf8279b3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1556 microversion: 2.1 time: 0.522816 Aug 05 20:13:15.323427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 546/1091] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:14 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1556 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:15.392563 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:15.394114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:15.401418 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:15.402338 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:15.403040 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:15.404397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:15.405118 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:15.405846 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:15.680921 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:15.690629 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1353ed30-ce4a-4fc0-8913-fadea731dfaf tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.303926 Aug 05 20:13:15.691738 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 546/1092] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:15 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:16.349238 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:16.350777 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:16.361144 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.362969 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.363886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.364811 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.365634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.366624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.677271 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:16.706741 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1d42c50c-6dd2-4bdd-bb22-ee2ab8311661 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1556 microversion: 2.1 time: 0.364121 Aug 05 20:13:16.712062 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 547/1093] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:16 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1556 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:16.713549 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:16.714170 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:16.724313 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.727481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.727838 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.728573 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.729036 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.730593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.935714 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:16.947398 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e3463182-34e0-446d-90a1-7ffadbce8811 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.237555 Aug 05 20:13:16.948001 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 547/1094] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:16 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:17.733512 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:17.735366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:17.744593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:17.745162 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:17.745750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:17.746611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:17.747136 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:17.748175 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:17.762339 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:17.963536 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:17.973656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:17.974475 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:17.975677 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-4e3c6926-ab21-430f-a097-c648d3627485 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1556 microversion: 2.1 time: 0.248605 Aug 05 20:13:17.977621 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 548/1095] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:17 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1556 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:17.982715 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:17.983321 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:17.983889 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:17.985997 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:17.986852 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:17.987563 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:17.994210 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:18.498716 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:18.512397 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-31c8df00-3259-4b9a-9211-52a584adf433 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.545517 Aug 05 20:13:18.512909 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 548/1096] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:17 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:18.999082 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:18.999750 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:19.013217 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.014114 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.014764 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.015697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.016633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.017913 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.052255 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-c855516f-7723-4ba4-9fbc-0d9380d0e268 req-bf13c482-6f50-4d76-bcc5-a98166a6cc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94cc1d6-32e5-4c24-8e26-e811d5a25389", "name": "network-vif-deleted", "tag": "ccf2670a-c2a3-4a62-ad5a-290565f526fe"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:19.069402 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-c855516f-7723-4ba4-9fbc-0d9380d0e268 req-bf13c482-6f50-4d76-bcc5-a98166a6cc9e service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.069807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-c855516f-7723-4ba4-9fbc-0d9380d0e268 req-bf13c482-6f50-4d76-bcc5-a98166a6cc9e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.070251 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-c855516f-7723-4ba4-9fbc-0d9380d0e268 req-bf13c482-6f50-4d76-bcc5-a98166a6cc9e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.100029 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-c855516f-7723-4ba4-9fbc-0d9380d0e268 req-bf13c482-6f50-4d76-bcc5-a98166a6cc9e service nova] Creating event network-vif-deleted:ccf2670a-c2a3-4a62-ad5a-290565f526fe for instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 on hv-cinder-85221 Aug 05 20:13:19.105401 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-c855516f-7723-4ba4-9fbc-0d9380d0e268 req-bf13c482-6f50-4d76-bcc5-a98166a6cc9e service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056630 Aug 05 20:13:19.108134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 549/1097] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:19.126270 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c083ae1c5a4444a55ecb26cfdd58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dacae2d58843f2b1b8b532759b83ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:19.147804 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-2a32f96e-2718-47b2-b5bc-fcdd799bc894 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 200 len: 1514 microversion: 2.1 time: 0.152756 Aug 05 20:13:19.148759 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 549/1098] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:18 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:19.534312 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:19.535164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:19.556917 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.557705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.558444 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.560620 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.563140 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.563694 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.860983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:19.880486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-19f2c323-f39d-4b71-9a66-bd9300dbbfe8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.345197 Aug 05 20:13:19.882828 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 550/1099] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:19 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:20.175697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:20.176841 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] [instance: c94cc1d6-32e5-4c24-8e26-e811d5a25389] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:20.185479 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:20.186075 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:20.186924 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:20.187723 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:20.188281 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:20.189067 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:20.205273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] HTTP exception thrown: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 could not be found. Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Request method failure captured: Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 HTTP/1.1 Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XknHtfwQzBrMdrJItdEv7mlDTDWd2-707FEqPZyK_HF8b82mH0r1ayCyhlU2nraT9X2-DwpAMZjrglTfYRULV0tAJO9gCxdmyOw9d20dEcdUTmCD-3DleDgYnDwcotIoyezekfhglVZiLffHmhwRE3-LK4niDfp2J4VwhyCZ1oo9h8 Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: c8dacae2d58843f2b1b8b532759b83ee Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-TestMinimumBasicScenario-1263328437 Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:13:20.207353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/c8dacae2d58843f2b1b8b532759b83ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_c8dacae2d58843f2b1b8b532759b83ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/c8dacae2d58843f2b1b8b532759b83ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/c8dacae2d58843f2b1b8b532759b83ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-TestMinimumBasicScenario-1263328437 Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: c8dacae2d58843f2b1b8b532759b83ee Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1263328437 Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-TestMinimumBasicScenario-1263328437-project Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 44c083ae1c5a4444a55ecb26cfdd58ca Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-TestMinimumBasicScenario-1263328437-project Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 could not be found. Aug 05 20:13:20.209044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'c94cc1d6-32e5-4c24-8e26-e811d5a25389'} Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 could not be found. Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:13:20.209954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 could not be found. Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 could not be found. Aug 05 20:13:20.211380 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:13:20.213891 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Returning 404 to user: Instance c94cc1d6-32e5-4c24-8e26-e811d5a25389 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:13:20.215004 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-073078f6-b031-48e0-9616-c661db77e322 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389" status: 404 len: 111 microversion: 2.1 time: 0.044438 Aug 05 20:13:20.216156 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 550/1100] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:20 2022] GET /compute/v2.1/servers/c94cc1d6-32e5-4c24-8e26-e811d5a25389 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:13:20.225177 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ffb187de-52e2-499f-9330-f038ce4aeca3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] Calling method '.version_select at 0x7f569666d5e0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:20.248242 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ffb187de-52e2-499f-9330-f038ce4aeca3 tempest-TestMinimumBasicScenario-1263328437 tempest-TestMinimumBasicScenario-1263328437-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1338265923" status: 202 len: 0 microversion: 2.1 time: 0.027113 Aug 05 20:13:20.249508 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 551/1101] 10.222.0.95 () {58 vars in 1272 bytes} [Fri Aug 5 20:13:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1338265923 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:13:20.901783 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:20.902397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:20.909504 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:20.909993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:20.910437 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:20.911965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:20.912604 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:20.913153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:21.123741 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:21.133519 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-aedab039-59be-45da-a008-1bdb65f95d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.235550 Aug 05 20:13:21.134093 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 551/1102] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:20 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:22.155110 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:22.156893 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:22.164957 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:22.165881 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:22.166491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:22.167369 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:22.168187 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:22.168775 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:22.403204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:22.412857 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ccfc3846-6cca-408e-9a49-ff60e477879c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.262081 Aug 05 20:13:22.413517 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 552/1103] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:22 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:23.449619 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:23.452970 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:23.473193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:23.476805 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:23.477267 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:23.478163 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:23.478803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:23.479393 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:23.666745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:23.676982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c50907e5-6ed9-4296-a4be-67e72859ffd8 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.238267 Aug 05 20:13:23.688396 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 552/1104] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:23 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:24.699459 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:24.700144 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:24.708355 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:24.708993 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:24.709446 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:24.710167 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:24.710626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:24.711055 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:24.967693 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:24.975914 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f698866f-34f9-4070-a582-5d5013719376 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.280222 Aug 05 20:13:24.976501 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 553/1105] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:24 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:25.341752 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-707413333", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1260976200", "security_groups": [{"name": "tempest-secgroup-smoke-1644851318"}], "block_device_mapping_v2": [{"uuid": "53ea1af7-8a1f-42b5-8e03-6c13981e688d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94116f7c-4077-445f-95b2-b2800adb5e8b"}]}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:25.493307 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.network.neutron [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] validate_networks() for [('94116f7c-4077-445f-95b2-b2800adb5e8b', None, None, None, None, None)] {{(pid=118175) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:13:25.900528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Flavor limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:13:25.901420 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Image limits 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:13:25.902055 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Flavor pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:13:25.902649 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Image pref 0:0:0 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:13:25.903061 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.virt.hardware [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118175) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:13:25.914296 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:25.914776 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:25.915869 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:25.917377 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:25.917843 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:25.918271 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:25.938020 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Getting quotas for project b0ab093edb944772ae7b6fd285178a43. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:13:25.942121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Getting quotas for user 6f89a5e4981e423b84d5f28b33bd9629 and project b0ab093edb944772ae7b6fd285178a43. Resources: {'instances', 'ram', 'cores'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:13:25.997527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:25.998141 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:26.002791 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Going to run 1 instances... {{(pid=118175) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:13:26.004917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='53ea1af7-8a1f-42b5-8e03-6c13981e688d',volume_size=None,volume_type=None)] {{(pid=118175) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:13:26.005117 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:26.005807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:26.006250 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:26.006957 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:26.007412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:26.007855 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:26.147353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-112a7899-a77a-41a8-b8b8-03ab5520d31c tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810156 Aug 05 20:13:26.148044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 553/1106] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:13:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 20:13:26.160253 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1debe669-2ffe-4b04-b0d9-9240a053314d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:26.161433 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1debe669-2ffe-4b04-b0d9-9240a053314d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:26.222947 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1debe669-2ffe-4b04-b0d9-9240a053314d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:26.230645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1debe669-2ffe-4b04-b0d9-9240a053314d tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1094 microversion: 2.1 time: 0.075438 Aug 05 20:13:26.231234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 554/1107] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:26 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:26.244027 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:26.259131 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-bf78c40d-2c14-4122-a6fb-06d388569e69 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.265990 Aug 05 20:13:26.264120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 554/1108] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:25 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:27.255415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:27.256321 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:27.266307 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:27.267070 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:27.267633 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:27.268469 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:27.268931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:27.269402 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:27.281360 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:27.282013 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:27.294123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:27.294622 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:27.295134 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:27.295895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:27.296347 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:27.296963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:27.347018 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:27.355830 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-71a3678a-7d1b-4ad2-a3c4-1aab1d0f2df9 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1192 microversion: 2.1 time: 0.104318 Aug 05 20:13:27.356861 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 555/1109] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:27 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:27.770857 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:27.782977 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-24099a7b-a35e-496c-b8ba-65b9fe24a547 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.505035 Aug 05 20:13:27.798787 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 555/1110] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:27 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:28.379825 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:28.380580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:28.399701 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:28.402730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:28.404801 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:28.407659 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:28.408366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:28.409661 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:28.576667 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:28.592658 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0b7047bc-fc74-4836-9809-92100a5972a3 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1210 microversion: 2.1 time: 0.219012 Aug 05 20:13:28.594998 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 556/1111] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:28 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:28.807505 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:28.808014 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:28.814568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:28.817067 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:28.817780 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:28.818395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:28.819736 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:28.820538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:28.821115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:29.326829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:29.336343 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6bb42a6c-c75c-49f9-b173-56fd0fe952ca tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1722 microversion: 2.1 time: 0.534745 Aug 05 20:13:29.337273 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 556/1112] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:28 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1722 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:29.618193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:29.618857 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:29.625918 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:29.626767 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:29.627373 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:29.628246 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:29.628687 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:29.629273 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:29.904815 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:29.918799 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1f9e0090-866b-482c-88f2-cbf4073a2e9a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.304586 Aug 05 20:13:29.934004 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 557/1113] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:29 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:30.164480 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-53f2f22c-cb13-4490-afb4-559d38d1c73c req-bb24d8e4-6b1a-4151-a84e-0df202a7726a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1263da64-1da7-413a-99f7-feb89c980120", "tag": "3a8ea464-537b-4d01-a831-8efd7a337079"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:30.181797 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-53f2f22c-cb13-4490-afb4-559d38d1c73c req-bb24d8e4-6b1a-4151-a84e-0df202a7726a service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:30.182785 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-53f2f22c-cb13-4490-afb4-559d38d1c73c req-bb24d8e4-6b1a-4151-a84e-0df202a7726a service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:30.183463 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-53f2f22c-cb13-4490-afb4-559d38d1c73c req-bb24d8e4-6b1a-4151-a84e-0df202a7726a service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:30.198249 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-53f2f22c-cb13-4490-afb4-559d38d1c73c req-bb24d8e4-6b1a-4151-a84e-0df202a7726a service nova] Creating event network-changed:3a8ea464-537b-4d01-a831-8efd7a337079 for instance 1263da64-1da7-413a-99f7-feb89c980120 on hv-cinder-85221 Aug 05 20:13:30.203437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-53f2f22c-cb13-4490-afb4-559d38d1c73c req-bb24d8e4-6b1a-4151-a84e-0df202a7726a service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042765 Aug 05 20:13:30.204424 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 557/1114] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:30.358624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:30.360973 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:30.369351 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:30.370398 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:30.370847 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:30.371557 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:30.372048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:30.372481 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:30.545319 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:30.554671 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-23342c84-948b-47e3-9826-2f7c9b54c4c5 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1699 microversion: 2.1 time: 0.200233 Aug 05 20:13:30.555255 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 558/1115] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:30 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1699 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:30.577242 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7e3c3e66-fe89-46be-9659-16adac87510f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:30.586204 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7e3c3e66-fe89-46be-9659-16adac87510f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:30.587142 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7e3c3e66-fe89-46be-9659-16adac87510f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:30.587806 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-7e3c3e66-fe89-46be-9659-16adac87510f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:30.670949 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-7e3c3e66-fe89-46be-9659-16adac87510f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Going to try to start instance {{(pid=118174) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 20:13:30.724192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7e3c3e66-fe89-46be-9659-16adac87510f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/action" status: 202 len: 0 microversion: 2.1 time: 0.151559 Aug 05 20:13:30.735885 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:30.738181 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:30.741690 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:30.742280 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 558/1116] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:13:30 2022] POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:13:30.746707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:30.747730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:30.748295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:30.749152 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:30.749809 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:30.750303 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:30.945947 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:30.948185 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:30.964607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:30.974806 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:30.977024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:30.977481 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:30.978862 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:30.979436 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:30.980108 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-7a7b5f6f-a7f1-43c9-9c12-ebe086f19fed tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1708 microversion: 2.1 time: 0.247929 Aug 05 20:13:30.980229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:30.985881 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 559/1117] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:30 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1708 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:31.319257 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:31.334878 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a1f4fbb6-8932-4dc4-b91e-83ca3a525954 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.395977 Aug 05 20:13:31.335830 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 559/1118] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:30 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:32.003577 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:32.004349 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:32.010961 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:32.011540 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:32.012160 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:32.012938 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:32.013386 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:32.013822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:32.160345 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:32.170050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3f98139a-e69a-46bc-ba19-1d738145050d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1708 microversion: 2.1 time: 0.170180 Aug 05 20:13:32.170676 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 560/1119] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:31 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1708 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:32.367945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:32.368576 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:32.376059 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:32.376557 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:32.377001 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:32.377701 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:32.378163 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:32.378591 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:32.523705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:32.531645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8dc94d02-6e3a-4cb2-9bac-a6faef1c03ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.167555 Aug 05 20:13:32.532523 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 560/1120] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:32 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:33.193618 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:33.194679 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:33.201839 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:33.202396 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:33.203111 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:33.204011 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:33.204475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:33.204909 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:33.381456 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:33.389394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-c7a61125-6b2a-4a67-9813-abfad2b0cc7e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1712 microversion: 2.1 time: 0.201839 Aug 05 20:13:33.389994 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 561/1121] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:33 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1712 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:33.554413 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:33.555180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:33.562567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:33.563262 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:33.563703 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:33.564429 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:33.565149 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:33.565482 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:33.707628 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:33.715486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4f87b225-d555-42d8-8c3a-2d8c5051549f tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.166023 Aug 05 20:13:33.716108 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 561/1122] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:33 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:34.736356 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:34.736886 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:34.743211 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:34.743706 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:34.744212 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:34.744910 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:34.745367 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:34.745796 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:34.887767 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:34.896318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b5a7d825-0535-465e-b19d-4ea3fc453229 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.164028 Aug 05 20:13:34.897035 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 562/1123] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:34 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:35.917556 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:35.918282 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:35.924963 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:35.925526 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:35.925957 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:35.926649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:35.927096 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:35.927515 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:36.061188 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:36.068791 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-4b744e34-6e8d-4493-adb9-36d89b205a09 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.154895 Aug 05 20:13:36.069290 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 562/1124] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:35 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:37.090093 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:37.090745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:37.093570 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:37.094257 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=8 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:37.100107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:37.100598 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:37.101037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:37.101736 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:37.102189 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:37.102614 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:37.237089 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:37.245008 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-6d634836-d9e6-4ecb-ba1f-3342181b0f87 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.158724 Aug 05 20:13:37.245518 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 563/1125] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:37 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:38.265052 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:38.265670 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:38.272074 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:38.272561 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:38.273001 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:38.273705 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:38.274144 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:38.274570 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:38.410416 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:38.418070 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-752edb3a-5cf4-4a29-9022-1dcf19d5b7f2 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.156816 Aug 05 20:13:38.418694 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 563/1126] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:38 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:39.440230 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:39.440878 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:39.449091 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:39.449697 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:39.450181 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:39.451081 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:39.451538 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:39.452258 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:39.626802 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:39.635232 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-013fa980-73ad-47cc-83e7-8aa27791b999 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.199401 Aug 05 20:13:39.635848 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 564/1127] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:39 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:40.659649 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:40.660460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:40.670847 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:40.671794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:40.672391 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:40.673184 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:40.673719 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:40.674310 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:40.813272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:40.821158 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8ffbed3e-0f1b-429b-9797-91a0c359ccd0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.167715 Aug 05 20:13:40.821733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 564/1128] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:40 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:41.662100 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-19cf4e36-4e11-4ee1-8a59-9e63a459076c req-fce34d74-a33d-466d-8c6b-6df06d45d6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1263da64-1da7-413a-99f7-feb89c980120", "name": "network-vif-plugged", "status": "completed", "tag": "3a8ea464-537b-4d01-a831-8efd7a337079"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:41.673438 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-19cf4e36-4e11-4ee1-8a59-9e63a459076c req-fce34d74-a33d-466d-8c6b-6df06d45d6f7 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:41.674073 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-19cf4e36-4e11-4ee1-8a59-9e63a459076c req-fce34d74-a33d-466d-8c6b-6df06d45d6f7 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:41.674507 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-19cf4e36-4e11-4ee1-8a59-9e63a459076c req-fce34d74-a33d-466d-8c6b-6df06d45d6f7 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:41.685914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-19cf4e36-4e11-4ee1-8a59-9e63a459076c req-fce34d74-a33d-466d-8c6b-6df06d45d6f7 service nova] Creating event network-vif-plugged:3a8ea464-537b-4d01-a831-8efd7a337079 for instance 1263da64-1da7-413a-99f7-feb89c980120 on hv-cinder-85221 Aug 05 20:13:41.691373 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-19cf4e36-4e11-4ee1-8a59-9e63a459076c req-fce34d74-a33d-466d-8c6b-6df06d45d6f7 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032985 Aug 05 20:13:41.692013 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 565/1129] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:41.842400 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:41.844012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:41.850568 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:41.851341 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:41.851575 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:41.852320 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:41.852781 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:41.853213 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:42.054006 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:42.062075 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ef57c7d2-efae-4bb6-8dd9-da081e8b99c7 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1266 microversion: 2.1 time: 0.223206 Aug 05 20:13:42.062640 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 565/1130] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:41 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:43.085220 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:43.085983 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:43.093221 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:43.095282 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:43.096078 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:43.097044 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:43.097745 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:43.098457 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:43.256287 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:43.264092 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ca9efa45-f310-4668-8ccb-49dd9953902b tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1454 microversion: 2.1 time: 0.184466 Aug 05 20:13:43.264964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 566/1131] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:43 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1454 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:43.284916 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:43.285533 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:43.292037 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:43.292527 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:43.292960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:43.293815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:43.294428 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:43.294861 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:43.300041 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:43.435680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:43.443409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-34de3715-2dbf-460c-ba8c-669d3788c7ed tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1454 microversion: 2.1 time: 0.163236 Aug 05 20:13:43.444031 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 566/1132] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:43 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:45.635523 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-33de5065-cd02-4a38-aeb4-92f65dbd775e req-20cc6d54-934d-4ad4-91c7-922cace725cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1263da64-1da7-413a-99f7-feb89c980120", "tag": "3a8ea464-537b-4d01-a831-8efd7a337079"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:45.646654 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-33de5065-cd02-4a38-aeb4-92f65dbd775e req-20cc6d54-934d-4ad4-91c7-922cace725cb service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:45.647215 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-33de5065-cd02-4a38-aeb4-92f65dbd775e req-20cc6d54-934d-4ad4-91c7-922cace725cb service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:45.647725 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-33de5065-cd02-4a38-aeb4-92f65dbd775e req-20cc6d54-934d-4ad4-91c7-922cace725cb service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:45.661325 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-33de5065-cd02-4a38-aeb4-92f65dbd775e req-20cc6d54-934d-4ad4-91c7-922cace725cb service nova] Creating event network-changed:3a8ea464-537b-4d01-a831-8efd7a337079 for instance 1263da64-1da7-413a-99f7-feb89c980120 on hv-cinder-85221 Aug 05 20:13:45.666241 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-33de5065-cd02-4a38-aeb4-92f65dbd775e req-20cc6d54-934d-4ad4-91c7-922cace725cb service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034471 Aug 05 20:13:45.666894 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 567/1133] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:14:11.992114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:11.992797 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:11.995161 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=21 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:11.995825 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=4 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:12.001599 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:12.002081 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:12.002514 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:12.003201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:12.003651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:12.004099 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:12.217597 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lazy-loading 'services' on Instance uuid 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:14:12.291669 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-744547e7-d3c4-4942-85dd-19925ed70211 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "DELETE /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/os-volume_attachments/de6171c9-3f00-4f98-ac32-e0ae2d8e6d06" status: 202 len: 0 microversion: 2.1 time: 0.303697 Aug 05 20:14:12.292466 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 567/1134] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:14:11 2022] DELETE /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/os-volume_attachments/de6171c9-3f00-4f98-ac32-e0ae2d8e6d06 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:14:13.411129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=17 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:13.412851 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=96 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:13.419368 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-9657e145-9ac2-4783-bba5-fcea948ece86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:14:13.428226 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9657e145-9ac2-4783-bba5-fcea948ece86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.428792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9657e145-9ac2-4783-bba5-fcea948ece86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.429347 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-9657e145-9ac2-4783-bba5-fcea948ece86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.451150 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-9657e145-9ac2-4783-bba5-fcea948ece86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Going to try to stop instance {{(pid=118175) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 20:14:13.493215 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-9657e145-9ac2-4783-bba5-fcea948ece86 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/action" status: 202 len: 0 microversion: 2.1 time: 0.084103 Aug 05 20:14:13.493860 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 568/1135] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:14:13 2022] POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:14:13.502849 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:13.503549 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:13.510084 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.510520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.510955 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.511654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.512212 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.512643 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.650199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:13.657996 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-20ee3890-0c14-4049-85e8-b96b93ea83bc tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1676 microversion: 2.1 time: 0.159741 Aug 05 20:14:13.658564 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 568/1136] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:13 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:14:14.680196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:14.680813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:14.686991 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:14.687476 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:14.688195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:14.688645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:14.689100 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:14.689528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:14.918627 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:14.926107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3684e4bd-c02b-4b66-992f-a57357479a9e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1676 microversion: 2.1 time: 0.251009 Aug 05 20:14:14.926673 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 569/1137] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:14 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:15.947093 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:15.947799 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:15.954238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:15.954723 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:15.955162 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:15.955887 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:15.956346 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:15.956776 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:16.089241 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:16.096683 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6ed31985-cb68-44b1-8294-9a5dd23aaab9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1676 microversion: 2.1 time: 0.153543 Aug 05 20:14:16.097247 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 569/1138] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:15 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:17.118580 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:17.119862 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:17.126406 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:17.126902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:17.127340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:17.128074 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:17.128528 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:17.128977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:17.269882 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:17.278071 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-58eaec19-e465-4dd6-abe5-3680965d8d6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1676 microversion: 2.1 time: 0.163925 Aug 05 20:14:17.278856 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 570/1139] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:17 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:18.300014 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:18.300627 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:18.307871 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:18.308359 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:18.308817 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:18.309489 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:18.309945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:18.310371 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:18.441607 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:18.449102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-720ea7a6-5570-4feb-9c66-df9e9f5cff4d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1676 microversion: 2.1 time: 0.153128 Aug 05 20:14:18.449701 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 570/1140] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:18 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:19.469703 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:19.470316 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:19.476645 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:19.477169 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:19.477701 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:19.478398 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:19.478854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:19.479283 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:19.615194 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:19.623295 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-115f8641-3e17-4bdc-ae3a-991b6e179f4f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1676 microversion: 2.1 time: 0.157485 Aug 05 20:14:19.623897 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 571/1141] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:19 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:20.644895 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:20.645440 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:20.651932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:20.652411 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:20.652847 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:20.653531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:20.653983 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:20.654404 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:20.784363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:20.791899 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f8637c0b-edcf-4d35-84e0-725cb33163a3 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1676 microversion: 2.1 time: 0.150947 Aug 05 20:14:20.792472 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 571/1142] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:20 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:21.813176 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:21.813724 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:21.820051 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:21.820531 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:21.820966 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:21.821650 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:21.822099 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:21.822523 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:21.948167 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:21.957195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1ba6b426-7bb2-46f8-8195-3ffb3b5a5bfe tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1676 microversion: 2.1 time: 0.148486 Aug 05 20:14:21.957764 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 572/1143] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:21 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:22.978363 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:22.978954 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:22.986795 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:22.987290 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:22.987727 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:22.988458 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:22.988910 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:22.989341 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:23.134226 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:23.143125 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ca951f13-198c-473a-87af-210a0f8ba789 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1676 microversion: 2.1 time: 0.168816 Aug 05 20:14:23.143834 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 572/1144] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:22 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:24.166340 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:24.167035 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:24.174720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:24.175452 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:24.176107 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:24.176965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:24.177582 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:24.178188 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:24.309424 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:24.316837 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-3f5715fd-0ad4-4198-b693-626a5848a893 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1653 microversion: 2.1 time: 0.154573 Aug 05 20:14:24.317404 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 573/1145] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:24 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:24.338042 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ce09bd7d-c622-42b6-843c-cf06fdd12540 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:14:24.345258 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ce09bd7d-c622-42b6-843c-cf06fdd12540 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:24.345754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ce09bd7d-c622-42b6-843c-cf06fdd12540 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:24.346192 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ce09bd7d-c622-42b6-843c-cf06fdd12540 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:24.368415 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ce09bd7d-c622-42b6-843c-cf06fdd12540 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Going to try to start instance {{(pid=118174) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 20:14:24.412278 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ce09bd7d-c622-42b6-843c-cf06fdd12540 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/action" status: 202 len: 0 microversion: 2.1 time: 0.077933 Aug 05 20:14:24.412882 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 573/1146] 10.222.0.95 () {60 vars in 1278 bytes} [Fri Aug 5 20:14:24 2022] POST /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:14:24.421206 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:24.421732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:24.428137 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:24.428634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:24.429072 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:24.430022 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:24.430732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:24.431452 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:24.565548 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:24.573114 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-38b26328-d9bc-4d3b-8ec3-e565bba70a3a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1662 microversion: 2.1 time: 0.155944 Aug 05 20:14:24.573687 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 574/1147] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:24 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:25.595814 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:25.596513 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:25.602721 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:25.603200 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:25.603635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:25.604358 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:25.604812 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:25.605230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:25.740581 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:25.749366 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ce2352b8-ca24-476b-98e4-982b3cd653d1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1662 microversion: 2.1 time: 0.158185 Aug 05 20:14:25.749932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 574/1148] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:25 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:26.415350 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:14:26.415559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Fri Aug 5 20:14:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:14:26.770562 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:26.771175 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:26.778279 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:26.778753 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:26.779193 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:26.780239 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:26.780732 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:26.781168 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:26.913364 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:26.921556 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-802530da-9bc4-42a2-9909-20341b95a635 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1666 microversion: 2.1 time: 0.154885 Aug 05 20:14:26.922121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 575/1149] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:26 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:59.193148 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b2c06ab0-aac6-4c4f-8af4-4ce0d333905d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:59.195605 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b2c06ab0-aac6-4c4f-8af4-4ce0d333905d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:59.197744 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=16 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:59.198395 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:59.206159 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2c06ab0-aac6-4c4f-8af4-4ce0d333905d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:59.206645 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2c06ab0-aac6-4c4f-8af4-4ce0d333905d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:59.207083 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2c06ab0-aac6-4c4f-8af4-4ce0d333905d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:59.207796 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2c06ab0-aac6-4c4f-8af4-4ce0d333905d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:59.208256 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2c06ab0-aac6-4c4f-8af4-4ce0d333905d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:59.208740 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b2c06ab0-aac6-4c4f-8af4-4ce0d333905d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:59.237686 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b2c06ab0-aac6-4c4f-8af4-4ce0d333905d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048731 Aug 05 20:14:59.238342 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 575/1150] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:14:59 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:14:59.299383 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:59.299956 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:59.302086 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=16 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:59.302740 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:59.308427 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:59.308914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:59.309354 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:59.310151 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:59.310517 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:59.311569 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:59.338229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:14:59.413568 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-744c85f0-b203-4251-9cfc-1beb5f00988f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "DELETE /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 204 len: 0 microversion: 2.1 time: 0.117986 Aug 05 20:14:59.414438 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 576/1151] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:14:59 2022] DELETE /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:14:59.423497 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:59.424415 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:59.431094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:59.431901 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:59.432407 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:59.433311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:59.433640 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:59.434060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:59.568079 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:59.575520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5e220dfc-7f99-4d37-a8b0-d9ab24feca54 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1672 microversion: 2.1 time: 0.156879 Aug 05 20:14:59.576454 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 576/1152] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:59 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:15:00.599313 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:00.600050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:00.606442 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:00.606992 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:00.608169 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:00.609115 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:00.609584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:00.610022 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:00.742355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:00.749796 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-055ac431-c12d-47ca-b9ac-f63b8a6dea2f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1672 microversion: 2.1 time: 0.154707 Aug 05 20:15:00.750355 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 577/1153] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:00 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:01.770610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:01.771237 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:01.777316 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:01.777805 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:01.778522 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:01.780015 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:01.780620 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:01.781060 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:02.028656 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:02.037036 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ad5d4d28-bc4a-4ba3-b591-2c1938b3a496 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1672 microversion: 2.1 time: 0.270204 Aug 05 20:15:02.037609 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 577/1154] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:01 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:02.950250 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-24e195e5-c6c5-490b-a0ab-02dd0a270804 req-da698f15-256e-469f-bb19-af035cd0c652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd18fa6-7db0-4b85-a28a-3ddb1f058787", "name": "network-vif-deleted", "tag": "1f42ea8e-3479-4841-ad1f-660c26f3b807"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:02.959971 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-24e195e5-c6c5-490b-a0ab-02dd0a270804 req-da698f15-256e-469f-bb19-af035cd0c652 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:02.960493 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-24e195e5-c6c5-490b-a0ab-02dd0a270804 req-da698f15-256e-469f-bb19-af035cd0c652 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:02.960880 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-24e195e5-c6c5-490b-a0ab-02dd0a270804 req-da698f15-256e-469f-bb19-af035cd0c652 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:02.972585 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-24e195e5-c6c5-490b-a0ab-02dd0a270804 req-da698f15-256e-469f-bb19-af035cd0c652 service nova] Creating event network-vif-deleted:1f42ea8e-3479-4841-ad1f-660c26f3b807 for instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 on hv-cinder-85221 Aug 05 20:15:02.977755 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-24e195e5-c6c5-490b-a0ab-02dd0a270804 req-da698f15-256e-469f-bb19-af035cd0c652 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246524 Aug 05 20:15:02.978354 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 578/1155] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:03.058492 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:03.059113 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:03.065598 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:03.066094 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:03.066565 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:03.067324 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:03.067798 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:03.068229 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:03.103126 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:03.103674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:03.104248 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:03.104765 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lazy-loading 'fault' on Instance uuid 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:15:03.151581 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:03.161098 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-829bf4c6-b79f-47cd-8b2d-ad85dd03957d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 200 len: 1326 microversion: 2.1 time: 0.106414 Aug 05 20:15:03.161674 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 578/1156] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:03 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:04.182964 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:04.183669 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:04.190541 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:04.191030 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:04.191472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:04.192195 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:04.192651 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:04.193083 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:04.208124 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] HTTP exception thrown: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Request method failure captured: Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 HTTP/1.1 Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XmENK1a8ruzBUsLfzOVTzR3ZTiyIrr9LY26AWrZtU7v6mcvvePaXOFflZ4K0jF2gSue-wOAxOj5GBIZyh9nmigBWfwSVzsy5a5euDlJ1L7cxdkquOFB40nD1l4DIyzKbTmTFOvjrDGyD2G5aG9gfXjfmF1Z5YjahBDfmO7mOKpNnlo Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:15:04.209733 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 1aff2581168d4498ad3823ed3e4ff3f9 Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:15:04.211430 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '0bd18fa6-7db0-4b85-a28a-3ddb1f058787'} Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:04.212503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:15:04.214187 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:04.215588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Returning 404 to user: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:04.215588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-cfc7a3bd-9ea9-4cdd-b8f5-168fb1ab1488 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 404 len: 111 microversion: 2.1 time: 0.032884 Aug 05 20:15:04.215588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 579/1157] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:04 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:04.220802 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c576a47b-736f-486c-82e3-c753f5ce5e18 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '.version_select at 0x7f569666d5e0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:04.239845 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c576a47b-736f-486c-82e3-c753f5ce5e18 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-465673037" status: 202 len: 0 microversion: 2.1 time: 0.023588 Aug 05 20:15:04.240412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 579/1158] 10.222.0.95 () {58 vars in 1218 bytes} [Fri Aug 5 20:15:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-465673037 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:15:04.862349 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-07db165e-efc1-470d-b267-9a878bfff4a9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'create', calling method: .version_select at 0x7f5691de3dc0>, body: {"keypair": {"name": "tempest-keypair-662728494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4sMIEULWiFI8AHtoLBeEvFDSoRVC8nuhrmUVMpLQ1Cj/8qHvsoCX0KZtJfE0S+bAidsY6230AjldmnjqALIghxkrsVicBxjQp+BPneYpysSCdglC2blKHPEesxCzJvHA=="}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:04.878248 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-07db165e-efc1-470d-b267-9a878bfff4a9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Getting quotas for project d3f34fc2ca3d4b32be53a5658100a336. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:15:04.884050 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.quota [None req-07db165e-efc1-470d-b267-9a878bfff4a9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Getting quotas for user 1aff2581168d4498ad3823ed3e4ff3f9 and project d3f34fc2ca3d4b32be53a5658100a336. Resources: {'key_pairs'} {{(pid=118175) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:15:04.907135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-07db165e-efc1-470d-b267-9a878bfff4a9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049947 Aug 05 20:15:04.907739 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 580/1159] 10.222.0.95 () {60 vars in 1159 bytes} [Fri Aug 5 20:15:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:06.187762 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1253609865", "imageRef": "7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d27ed54c-ce86-461d-a6cf-3258bf554f65"}], "security_groups": [{"name": "tempest-securitygroup--487153625"}], "key_name": "tempest-keypair-662728494", "user_data": "}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:06.295439 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.network.neutron [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] validate_networks() for [('d27ed54c-ce86-461d-a6cf-3258bf554f65', None, None, None, None, None)] {{(pid=118174) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:15:06.683169 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Flavor limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:15:06.683596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Image limits 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:15:06.684127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Flavor pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:15:06.684516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Image pref 0:0:0 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:15:06.684919 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.virt.hardware [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118174) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:15:06.694220 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:06.694699 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:06.695128 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:06.695907 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:06.696810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:06.697354 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:06.715449 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Getting quotas for project d3f34fc2ca3d4b32be53a5658100a336. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:15:06.720115 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.quota [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Getting quotas for user 1aff2581168d4498ad3823ed3e4ff3f9 and project d3f34fc2ca3d4b32be53a5658100a336. Resources: {'instances', 'ram', 'cores'} {{(pid=118174) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:15:06.730829 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Going to run 1 instances... {{(pid=118174) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:15:06.733129 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aa27bd5-23bb-401d-9dc7-7a1acdf3ad9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118174) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:15:06.782292 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-225729dd-92d5-4986-8c37-75950e4bdbb9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601007 Aug 05 20:15:06.782938 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 580/1160] 10.222.0.95 () {60 vars in 1147 bytes} [Fri Aug 5 20:15:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:15:06.794054 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-82714bcd-7364-497b-8a13-b410b200de6e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:06.794705 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-82714bcd-7364-497b-8a13-b410b200de6e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:06.849741 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-82714bcd-7364-497b-8a13-b410b200de6e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:06.856624 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-82714bcd-7364-497b-8a13-b410b200de6e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1237 microversion: 2.1 time: 0.066832 Aug 05 20:15:06.857714 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 581/1161] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:06 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:07.878733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:07.879378 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:07.886981 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:07.887473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:07.887950 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:07.888949 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:07.889383 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:07.889872 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:07.958613 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:07.967681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b9a049ef-7c90-4202-8f0d-2e6492f67ccb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1307 microversion: 2.1 time: 0.092710 Aug 05 20:15:07.968287 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 581/1162] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:07 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:08.990000 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:08.990977 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:08.997762 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:08.998259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:08.998803 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:08.999984 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:09.000455 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:09.000919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:09.149137 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:09.158360 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-324915b8-b033-42d3-904a-6dd8dca2c01b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1362 microversion: 2.1 time: 0.172072 Aug 05 20:15:09.159068 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 582/1163] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:08 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:09.474845 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [req-d433527c-2626-47ad-b12f-e5c70753e07c req-c73d7909-452d-4026-920b-21a989fd3779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e9837a4-5af5-4ecf-9f3b-06aad334d879", "tag": "868a1c61-7087-4811-a208-ec39e2da7154"}]} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:09.486684 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-d433527c-2626-47ad-b12f-e5c70753e07c req-c73d7909-452d-4026-920b-21a989fd3779 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:09.487452 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-d433527c-2626-47ad-b12f-e5c70753e07c req-c73d7909-452d-4026-920b-21a989fd3779 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:09.487923 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [req-d433527c-2626-47ad-b12f-e5c70753e07c req-c73d7909-452d-4026-920b-21a989fd3779 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:09.499766 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.compute.server_external_events [req-d433527c-2626-47ad-b12f-e5c70753e07c req-c73d7909-452d-4026-920b-21a989fd3779 service nova] Creating event network-changed:868a1c61-7087-4811-a208-ec39e2da7154 for instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 on hv-cinder-85221 Aug 05 20:15:09.504820 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [req-d433527c-2626-47ad-b12f-e5c70753e07c req-c73d7909-452d-4026-920b-21a989fd3779 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033750 Aug 05 20:15:09.505330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 582/1164] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:10.180140 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:10.180792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:10.189289 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:10.189785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:10.190238 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:10.190965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:10.191409 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:10.191871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:10.327196 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:10.334765 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0859c7d2-4d89-42db-9c03-816f5113dba9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1362 microversion: 2.1 time: 0.158595 Aug 05 20:15:10.335338 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 583/1165] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:10 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:15:11.356822 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:11.357592 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:11.364005 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:11.364502 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:11.364945 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:11.365654 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:11.366114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:11.366542 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:11.505965 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:11.513903 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-35201f98-17e4-4387-a99b-464974d5bc5d tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1362 microversion: 2.1 time: 0.161905 Aug 05 20:15:11.514459 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 583/1166] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:11 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:12.534000 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:12.534658 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:12.540674 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:12.541122 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:12.541567 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:12.542274 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:12.542736 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:12.543176 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:12.672913 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:12.680329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b403123e-82c9-4a89-9485-ab7d342983e1 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1362 microversion: 2.1 time: 0.150381 Aug 05 20:15:12.680896 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 584/1167] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:12 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:13.701534 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:13.702081 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:13.708546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.709033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.709476 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.710172 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.710629 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.711059 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.845198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:13.852507 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-85985163-6aed-43c2-81a9-9c6154cd9ca4 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1362 microversion: 2.1 time: 0.154971 Aug 05 20:15:13.853057 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 584/1168] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:13 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:14.088626 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-02eb3fa4-96d5-409a-aba6-2ae24c08c369 req-67f64c39-22cb-4bdf-bca1-43e3a5308e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e9837a4-5af5-4ecf-9f3b-06aad334d879", "name": "network-vif-plugged", "status": "completed", "tag": "868a1c61-7087-4811-a208-ec39e2da7154"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:14.100353 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-02eb3fa4-96d5-409a-aba6-2ae24c08c369 req-67f64c39-22cb-4bdf-bca1-43e3a5308e43 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:14.101194 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-02eb3fa4-96d5-409a-aba6-2ae24c08c369 req-67f64c39-22cb-4bdf-bca1-43e3a5308e43 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:14.101642 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-02eb3fa4-96d5-409a-aba6-2ae24c08c369 req-67f64c39-22cb-4bdf-bca1-43e3a5308e43 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:14.113169 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-02eb3fa4-96d5-409a-aba6-2ae24c08c369 req-67f64c39-22cb-4bdf-bca1-43e3a5308e43 service nova] Creating event network-vif-plugged:868a1c61-7087-4811-a208-ec39e2da7154 for instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 on hv-cinder-85221 Aug 05 20:15:14.119584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-02eb3fa4-96d5-409a-aba6-2ae24c08c369 req-67f64c39-22cb-4bdf-bca1-43e3a5308e43 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034158 Aug 05 20:15:14.121210 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 585/1169] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:14.873328 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:14.873915 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:14.880290 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:14.880768 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:14.881201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:14.881887 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:14.882333 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:14.882755 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:15.017701 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:15.025171 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-6d91aebd-32a3-46f8-98ed-f46123ea3c1e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1362 microversion: 2.1 time: 0.155810 Aug 05 20:15:15.025735 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 585/1170] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:14 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:16.046048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:16.046741 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:16.053854 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:16.054352 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:16.054770 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:16.055460 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:16.055954 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:16.056378 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:16.429109 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:16.437475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-5512907b-3c7b-4f48-a7c8-3b8135eb851a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1548 microversion: 2.1 time: 0.395803 Aug 05 20:15:16.438037 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 586/1171] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:16 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1548 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:16.457803 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-48cd3b6a-cc1a-4adc-87e4-2ee5efc4e147 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:16.458302 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-48cd3b6a-cc1a-4adc-87e4-2ee5efc4e147 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:16.464838 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48cd3b6a-cc1a-4adc-87e4-2ee5efc4e147 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:16.465316 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48cd3b6a-cc1a-4adc-87e4-2ee5efc4e147 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:16.465750 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48cd3b6a-cc1a-4adc-87e4-2ee5efc4e147 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:16.466567 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48cd3b6a-cc1a-4adc-87e4-2ee5efc4e147 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:16.467020 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48cd3b6a-cc1a-4adc-87e4-2ee5efc4e147 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:16.467442 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-48cd3b6a-cc1a-4adc-87e4-2ee5efc4e147 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:16.548342 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-48cd3b6a-cc1a-4adc-87e4-2ee5efc4e147 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094253 Aug 05 20:15:16.548961 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 586/1172] 10.222.0.95 () {58 vars in 1275 bytes} [Fri Aug 5 20:15:16 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:17.474280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-141225c4-1318-4027-8467-1d35e30324ef req-74fb6f23-992e-4a0c-8a51-712665d3956d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e9837a4-5af5-4ecf-9f3b-06aad334d879", "tag": "868a1c61-7087-4811-a208-ec39e2da7154"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:17.479205 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell0:SELECT=6 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:17.486596 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-141225c4-1318-4027-8467-1d35e30324ef req-74fb6f23-992e-4a0c-8a51-712665d3956d service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:17.487631 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-141225c4-1318-4027-8467-1d35e30324ef req-74fb6f23-992e-4a0c-8a51-712665d3956d service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:17.487631 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-141225c4-1318-4027-8467-1d35e30324ef req-74fb6f23-992e-4a0c-8a51-712665d3956d service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:17.499129 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-141225c4-1318-4027-8467-1d35e30324ef req-74fb6f23-992e-4a0c-8a51-712665d3956d service nova] Creating event network-changed:868a1c61-7087-4811-a208-ec39e2da7154 for instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 on hv-cinder-85221 Aug 05 20:15:17.503973 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-141225c4-1318-4027-8467-1d35e30324ef req-74fb6f23-992e-4a0c-8a51-712665d3956d service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033327 Aug 05 20:15:17.504581 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 587/1173] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:18.903538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:18.905371 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell0:SELECT=6 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:18.911450 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:18.911975 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:18.912391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-368ff0bb-158a-479f-a4b4-eaf352b43450 req-e79db576-ba23-4099-9086-539cd2808c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1263da64-1da7-413a-99f7-feb89c980120", "tag": "3a8ea464-537b-4d01-a831-8efd7a337079"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:18.919663 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:18.920610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:18.921053 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:18.921765 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:18.922219 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:18.922642 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:18.936787 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-368ff0bb-158a-479f-a4b4-eaf352b43450 req-e79db576-ba23-4099-9086-539cd2808c74 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:18.937266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-368ff0bb-158a-479f-a4b4-eaf352b43450 req-e79db576-ba23-4099-9086-539cd2808c74 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:18.937700 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-368ff0bb-158a-479f-a4b4-eaf352b43450 req-e79db576-ba23-4099-9086-539cd2808c74 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:18.954121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-368ff0bb-158a-479f-a4b4-eaf352b43450 req-e79db576-ba23-4099-9086-539cd2808c74 service nova] Creating event network-changed:3a8ea464-537b-4d01-a831-8efd7a337079 for instance 1263da64-1da7-413a-99f7-feb89c980120 on hv-cinder-85221 Aug 05 20:15:18.958807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Going to try to terminate instance {{(pid=118174) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:15:18.959574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-368ff0bb-158a-479f-a4b4-eaf352b43450 req-e79db576-ba23-4099-9086-539cd2808c74 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053042 Aug 05 20:15:18.960919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 588/1174] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:19.060272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-d2af458d-278b-4806-a2c8-285953af99c6 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "DELETE /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 204 len: 0 microversion: 2.1 time: 0.157385 Aug 05 20:15:19.061120 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 587/1175] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:15:18 2022] DELETE /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:15:19.071816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:19.072533 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:19.088210 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:19.088972 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:19.091771 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:19.092717 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:19.093346 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:19.093941 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:19.245788 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:19.257902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0ba7480e-c4be-42db-814d-9a52ce8caecb tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1579 microversion: 2.1 time: 0.191907 Aug 05 20:15:19.258781 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 589/1176] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:19 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:20.282820 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:20.283516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:20.289891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:20.290381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:20.290820 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:20.291516 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:20.292003 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:20.292471 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:20.467065 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:20.475319 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0c2913cf-7e06-49e9-bebd-f8cc586ebf4a tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1579 microversion: 2.1 time: 0.196842 Aug 05 20:15:20.475923 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 588/1177] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:20 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1579 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:21.330982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-24723898-3259-4fe5-99e3-3fad7d297fe6 req-5d2d2592-dfe8-492c-9341-aa82dd854d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1263da64-1da7-413a-99f7-feb89c980120", "name": "network-vif-deleted", "tag": "3a8ea464-537b-4d01-a831-8efd7a337079"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:21.342688 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-24723898-3259-4fe5-99e3-3fad7d297fe6 req-5d2d2592-dfe8-492c-9341-aa82dd854d72 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:21.343094 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-24723898-3259-4fe5-99e3-3fad7d297fe6 req-5d2d2592-dfe8-492c-9341-aa82dd854d72 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:21.343526 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-24723898-3259-4fe5-99e3-3fad7d297fe6 req-5d2d2592-dfe8-492c-9341-aa82dd854d72 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:21.355869 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-24723898-3259-4fe5-99e3-3fad7d297fe6 req-5d2d2592-dfe8-492c-9341-aa82dd854d72 service nova] Creating event network-vif-deleted:3a8ea464-537b-4d01-a831-8efd7a337079 for instance 1263da64-1da7-413a-99f7-feb89c980120 on hv-cinder-85221 Aug 05 20:15:21.362631 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-24723898-3259-4fe5-99e3-3fad7d297fe6 req-5d2d2592-dfe8-492c-9341-aa82dd854d72 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034766 Aug 05 20:15:21.363435 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 590/1178] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:21.497548 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:21.498180 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:21.504502 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:21.504984 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:21.505416 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:21.506111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:21.506561 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:21.507011 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:21.569577 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:21.577842 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-3b3574b3-ff46-44f1-a247-d828f45bce26 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 200 len: 1225 microversion: 2.1 time: 0.084348 Aug 05 20:15:21.578404 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 589/1179] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:21 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:22.599148 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:22.599859 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1263da64-1da7-413a-99f7-feb89c980120] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:22.606391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:22.606919 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:22.607527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:22.608294 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:22.608720 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:22.609142 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:22.622415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] HTTP exception thrown: Instance 1263da64-1da7-413a-99f7-feb89c980120 could not be found. Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Request method failure captured: Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 HTTP/1.1 Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XhzbAOs_Rb5x47ulHugnvs82H0RFcMVuKB4COdk70vwt7b5Nn1UpOcj7xCRWmBnwY7SHIJu20lI6qxme3P6Yz5MbIvV7u8dDiuPP3nG1NRbJlUbM83RT3JCzjFZl13Rv-LOkw-1tmfa26hH_5sWlLgwIFzn82PJxc6995I0qYGgy7Q Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:15:22.624308 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 6f89a5e4981e423b84d5f28b33bd9629 Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 1263da64-1da7-413a-99f7-feb89c980120 could not be found. Aug 05 20:15:22.626014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '1263da64-1da7-413a-99f7-feb89c980120'} Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1263da64-1da7-413a-99f7-feb89c980120 could not be found. Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:22.626982 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1263da64-1da7-413a-99f7-feb89c980120 could not be found. Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1263da64-1da7-413a-99f7-feb89c980120 could not be found. Aug 05 20:15:22.628634 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:22.629993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Returning 404 to user: Instance 1263da64-1da7-413a-99f7-feb89c980120 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:22.629993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-bcba7579-0305-4c7d-9851-546a7a71d127 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120" status: 404 len: 111 microversion: 2.1 time: 0.030782 Aug 05 20:15:22.629993 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 591/1180] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:22 2022] GET /compute/v2.1/servers/1263da64-1da7-413a-99f7-feb89c980120 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:25.705909 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:25.706581 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:25.708379 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-217ad512-e5cb-45dc-a22d-3670864a4777 req-4be4b87f-32f9-4436-8e69-d51e3da9a039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd121f3-db74-4106-b72b-9145b5df9e78", "tag": "583179e9-2e27-4001-8b5f-31b195762ee5"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:25.713493 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:25.713978 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:25.714415 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:25.715127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:25.715581 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:25.716033 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:25.720325 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-217ad512-e5cb-45dc-a22d-3670864a4777 req-4be4b87f-32f9-4436-8e69-d51e3da9a039 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:25.720800 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-217ad512-e5cb-45dc-a22d-3670864a4777 req-4be4b87f-32f9-4436-8e69-d51e3da9a039 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:25.721472 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-217ad512-e5cb-45dc-a22d-3670864a4777 req-4be4b87f-32f9-4436-8e69-d51e3da9a039 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:25.733597 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-217ad512-e5cb-45dc-a22d-3670864a4777 req-4be4b87f-32f9-4436-8e69-d51e3da9a039 service nova] Creating event network-changed:583179e9-2e27-4001-8b5f-31b195762ee5 for instance 1bd121f3-db74-4106-b72b-9145b5df9e78 on hv-cinder-85221 Aug 05 20:15:25.738422 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-217ad512-e5cb-45dc-a22d-3670864a4777 req-4be4b87f-32f9-4436-8e69-d51e3da9a039 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034055 Aug 05 20:15:25.739532 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 592/1181] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:25.750691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Going to try to terminate instance {{(pid=118174) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:15:25.797925 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:25.845102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ff24d9b6-a8e8-4531-8a3e-99e2668f78f0 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "DELETE /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 204 len: 0 microversion: 2.1 time: 0.143352 Aug 05 20:15:25.846111 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 590/1182] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:15:25 2022] DELETE /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:15:25.855468 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:25.856132 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:25.862615 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:25.863096 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:25.863530 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:25.864247 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:25.864700 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:25.865121 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:26.004452 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:26.012383 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-20153d3e-4b1c-405b-897a-49f57a3d0ec5 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1578 microversion: 2.1 time: 0.161097 Aug 05 20:15:26.012973 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 593/1183] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:25 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:27.034869 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:27.035578 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:27.042484 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:27.042891 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:27.043337 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:27.044095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:27.044558 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:27.044987 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:27.256368 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:27.264057 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-c00d0025-a78a-4054-828d-a5bdf87b0125 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1578 microversion: 2.1 time: 0.233574 Aug 05 20:15:27.264680 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 591/1184] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:27 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:28.235525 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-6056528f-51fa-42f7-ace3-b8c19b4d3025 req-a26da21c-b139-4b0f-a13a-74a85529344e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd121f3-db74-4106-b72b-9145b5df9e78", "name": "network-vif-deleted", "tag": "583179e9-2e27-4001-8b5f-31b195762ee5"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:28.247392 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-6056528f-51fa-42f7-ace3-b8c19b4d3025 req-a26da21c-b139-4b0f-a13a-74a85529344e service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:28.249433 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-6056528f-51fa-42f7-ace3-b8c19b4d3025 req-a26da21c-b139-4b0f-a13a-74a85529344e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:28.250235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-6056528f-51fa-42f7-ace3-b8c19b4d3025 req-a26da21c-b139-4b0f-a13a-74a85529344e service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:28.262010 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-6056528f-51fa-42f7-ace3-b8c19b4d3025 req-a26da21c-b139-4b0f-a13a-74a85529344e service nova] Creating event network-vif-deleted:583179e9-2e27-4001-8b5f-31b195762ee5 for instance 1bd121f3-db74-4106-b72b-9145b5df9e78 on hv-cinder-85221 Aug 05 20:15:28.268770 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-6056528f-51fa-42f7-ace3-b8c19b4d3025 req-a26da21c-b139-4b0f-a13a-74a85529344e service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037539 Aug 05 20:15:28.269371 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 594/1185] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:28.286024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:28.286642 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:28.293127 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:28.293611 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:28.294049 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:28.294737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:28.295303 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:28.295737 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:28.364069 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f89a5e4981e423b84d5f28b33bd9629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ab093edb944772ae7b6fd285178a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:28.371465 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-699fe235-b706-4c74-87ed-e4cdea9d2840 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 200 len: 1225 microversion: 2.1 time: 0.089421 Aug 05 20:15:28.372330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 592/1186] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:28 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:29.393496 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:29.394190 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: 1bd121f3-db74-4106-b72b-9145b5df9e78] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:29.396653 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:29.402304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:29.402792 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:29.403235 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:29.403979 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:29.404444 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:29.405007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:29.409283 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:29.422827 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] HTTP exception thrown: Instance 1bd121f3-db74-4106-b72b-9145b5df9e78 could not be found. Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Request method failure captured: Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 HTTP/1.1 Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XhzbAOs_Rb5x47ulHugnvs82H0RFcMVuKB4COdk70vwt7b5Nn1UpOcj7xCRWmBnwY7SHIJu20lI6qxme3P6Yz5MbIvV7u8dDiuPP3nG1NRbJlUbM83RT3JCzjFZl13Rv-LOkw-1tmfa26hH_5sWlLgwIFzn82PJxc6995I0qYGgy7Q Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:15:29.424607 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 6f89a5e4981e423b84d5f28b33bd9629 Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 1bd121f3-db74-4106-b72b-9145b5df9e78 could not be found. Aug 05 20:15:29.425999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '1bd121f3-db74-4106-b72b-9145b5df9e78'} Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd121f3-db74-4106-b72b-9145b5df9e78 could not be found. Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:29.426828 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd121f3-db74-4106-b72b-9145b5df9e78 could not be found. Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd121f3-db74-4106-b72b-9145b5df9e78 could not be found. Aug 05 20:15:29.428394 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.429616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Returning 404 to user: Instance 1bd121f3-db74-4106-b72b-9145b5df9e78 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:29.429616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-50701a80-0403-41b1-86e0-2eb168aaef28 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78" status: 404 len: 111 microversion: 2.1 time: 0.037273 Aug 05 20:15:29.431011 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 595/1187] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:29 2022] GET /compute/v2.1/servers/1bd121f3-db74-4106-b72b-9145b5df9e78 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:29.867635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:29.868184 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:29.870677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:29.876988 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:29.877474 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:29.877908 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:29.878598 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:29.879044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:29.879463 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:29.894948 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] HTTP exception thrown: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Request method failure captured: Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a HTTP/1.1 Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XhzbAOs_Rb5x47ulHugnvs82H0RFcMVuKB4COdk70vwt7b5Nn1UpOcj7xCRWmBnwY7SHIJu20lI6qxme3P6Yz5MbIvV7u8dDiuPP3nG1NRbJlUbM83RT3JCzjFZl13Rv-LOkw-1tmfa26hH_5sWlLgwIFzn82PJxc6995I0qYGgy7Q Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:15:29.896651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 6f89a5e4981e423b84d5f28b33bd9629 Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.898293 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': 'e1af2142-ec43-40b7-b612-0ba54aba802a'} Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:29.899236 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.900800 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.902574 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Returning 404 to user: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:29.902574 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-498fa7b8-72d6-40b5-9ed2-557fa3b00238 tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "DELETE /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 404 len: 111 microversion: 2.1 time: 0.034314 Aug 05 20:15:29.902574 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 593/1188] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:15:29 2022] DELETE /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:29.908090 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:29.908708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] [instance: e1af2142-ec43-40b7-b612-0ba54aba802a] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:29.915756 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:29.916261 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:29.916704 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:29.917399 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:29.917859 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:29.918290 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:29.932719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] HTTP exception thrown: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Request method failure captured: Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a HTTP/1.1 Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XhzbAOs_Rb5x47ulHugnvs82H0RFcMVuKB4COdk70vwt7b5Nn1UpOcj7xCRWmBnwY7SHIJu20lI6qxme3P6Yz5MbIvV7u8dDiuPP3nG1NRbJlUbM83RT3JCzjFZl13Rv-LOkw-1tmfa26hH_5sWlLgwIFzn82PJxc6995I0qYGgy7Q Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:15:29.934256 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/b0ab093edb944772ae7b6fd285178a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: b0ab093edb944772ae7b6fd285178a43 Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969061764 Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 6f89a5e4981e423b84d5f28b33bd9629 Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-TestVolumeBootPattern-1969061764-project Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.935953 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': 'e1af2142-ec43-40b7-b612-0ba54aba802a'} Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:29.937318 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. Aug 05 20:15:29.938822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:15:29.940190 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Returning 404 to user: Instance e1af2142-ec43-40b7-b612-0ba54aba802a could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:29.940190 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ad0ef2d2-8536-41ac-802c-03c30499831e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a" status: 404 len: 111 microversion: 2.1 time: 0.032602 Aug 05 20:15:29.940190 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 596/1189] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:29 2022] GET /compute/v2.1/servers/e1af2142-ec43-40b7-b612-0ba54aba802a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:31.228838 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-1ab0765b-bad6-4a46-9e83-5965c341068e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] Calling method '.version_select at 0x7f56927a4e50>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:31.250164 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-1ab0765b-bad6-4a46-9e83-5965c341068e tempest-TestVolumeBootPattern-1969061764 tempest-TestVolumeBootPattern-1969061764-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1260976200" status: 202 len: 0 microversion: 2.1 time: 0.025455 Aug 05 20:15:31.250967 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 594/1190] 10.222.0.95 () {58 vars in 1263 bytes} [Fri Aug 5 20:15:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1260976200 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:15:53.560280 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-567d666b-953d-4b31-8676-169c9763825e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:53.560875 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-567d666b-953d-4b31-8676-169c9763825e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:53.563718 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:53.564730 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=3 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:53.570433 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-567d666b-953d-4b31-8676-169c9763825e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:53.570925 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-567d666b-953d-4b31-8676-169c9763825e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:53.571372 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-567d666b-953d-4b31-8676-169c9763825e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:53.572113 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-567d666b-953d-4b31-8676-169c9763825e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:53.572579 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-567d666b-953d-4b31-8676-169c9763825e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:53.573012 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-567d666b-953d-4b31-8676-169c9763825e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:53.602570 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-567d666b-953d-4b31-8676-169c9763825e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/ips" status: 200 len: 146 microversion: 2.1 time: 0.046103 Aug 05 20:15:53.603162 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 597/1191] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:15:53 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:54.931857 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:54.932596 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:54.936990 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0566aad7-e70d-468c-8271-6e64e5371231 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74407e8c-9e45-457c-b3d8-311ec1eb8610"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:54.940008 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-0566aad7-e70d-468c-8271-6e64e5371231 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:54.948199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0566aad7-e70d-468c-8271-6e64e5371231 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.948807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0566aad7-e70d-468c-8271-6e64e5371231 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.949328 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0566aad7-e70d-468c-8271-6e64e5371231 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:54.950022 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0566aad7-e70d-468c-8271-6e64e5371231 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.950473 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0566aad7-e70d-468c-8271-6e64e5371231 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.950892 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-0566aad7-e70d-468c-8271-6e64e5371231 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:55.209858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0566aad7-e70d-468c-8271-6e64e5371231 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279158 Aug 05 20:15:55.210549 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 595/1192] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:15:54 2022] POST /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:02.731999 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fa2a4436-b8ca-4467-922a-d6610c885e6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:02.734183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fa2a4436-b8ca-4467-922a-d6610c885e6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:02.740942 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fa2a4436-b8ca-4467-922a-d6610c885e6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:02.741436 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fa2a4436-b8ca-4467-922a-d6610c885e6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:02.741877 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fa2a4436-b8ca-4467-922a-d6610c885e6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:02.742574 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fa2a4436-b8ca-4467-922a-d6610c885e6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:02.743033 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fa2a4436-b8ca-4467-922a-d6610c885e6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:02.743465 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fa2a4436-b8ca-4467-922a-d6610c885e6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:02.774019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fa2a4436-b8ca-4467-922a-d6610c885e6a tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Aug 05 20:16:02.774572 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 598/1193] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:16:02 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:02.786416 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-de198ef9-a158-4e86-9b74-dc998dce6f6c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:02.787001 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-de198ef9-a158-4e86-9b74-dc998dce6f6c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:02.793123 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de198ef9-a158-4e86-9b74-dc998dce6f6c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:02.793610 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de198ef9-a158-4e86-9b74-dc998dce6f6c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:02.794050 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de198ef9-a158-4e86-9b74-dc998dce6f6c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:02.794741 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de198ef9-a158-4e86-9b74-dc998dce6f6c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:02.795199 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de198ef9-a158-4e86-9b74-dc998dce6f6c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:02.795625 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-de198ef9-a158-4e86-9b74-dc998dce6f6c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:02.824691 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-de198ef9-a158-4e86-9b74-dc998dce6f6c tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/74407e8c-9e45-457c-b3d8-311ec1eb8610" status: 200 len: 194 microversion: 2.1 time: 0.043261 Aug 05 20:16:02.825271 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 596/1194] 10.222.0.95 () {58 vars in 1413 bytes} [Fri Aug 5 20:16:02 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/74407e8c-9e45-457c-b3d8-311ec1eb8610 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:04.161080 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-283b6a19-8697-4eef-8d5c-ddc2aba029a6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "781f12de-ec9c-4275-99c9-db8efd448b09"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:16:04.163369 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-283b6a19-8697-4eef-8d5c-ddc2aba029a6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:04.169810 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-283b6a19-8697-4eef-8d5c-ddc2aba029a6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:04.170294 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-283b6a19-8697-4eef-8d5c-ddc2aba029a6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:04.170727 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-283b6a19-8697-4eef-8d5c-ddc2aba029a6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:04.171408 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-283b6a19-8697-4eef-8d5c-ddc2aba029a6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:04.171884 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-283b6a19-8697-4eef-8d5c-ddc2aba029a6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:04.172306 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-283b6a19-8697-4eef-8d5c-ddc2aba029a6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:04.432314 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-283b6a19-8697-4eef-8d5c-ddc2aba029a6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "POST /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275562 Aug 05 20:16:04.432915 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 599/1195] 10.222.0.95 () {60 vars in 1323 bytes} [Fri Aug 5 20:16:04 2022] POST /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:07.574272 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:16:07.574929 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Fri Aug 5 20:16:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:16:11.974858 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-f66ab714-019e-4624-a5f1-c8c15e16e673 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:11.977024 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-f66ab714-019e-4624-a5f1-c8c15e16e673 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:11.983489 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f66ab714-019e-4624-a5f1-c8c15e16e673 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:11.984017 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f66ab714-019e-4624-a5f1-c8c15e16e673 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:11.984460 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f66ab714-019e-4624-a5f1-c8c15e16e673 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:11.985797 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f66ab714-019e-4624-a5f1-c8c15e16e673 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:11.986246 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f66ab714-019e-4624-a5f1-c8c15e16e673 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:11.986677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-f66ab714-019e-4624-a5f1-c8c15e16e673 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:12.015754 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-f66ab714-019e-4624-a5f1-c8c15e16e673 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044829 Aug 05 20:16:12.016854 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 597/1196] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:16:11 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:16:12.163185 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-2f24c38a-8b69-45ff-a677-bab248b42e3b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:12.163727 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-2f24c38a-8b69-45ff-a677-bab248b42e3b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:12.169917 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f24c38a-8b69-45ff-a677-bab248b42e3b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:12.170391 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f24c38a-8b69-45ff-a677-bab248b42e3b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:12.170822 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f24c38a-8b69-45ff-a677-bab248b42e3b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:12.171503 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f24c38a-8b69-45ff-a677-bab248b42e3b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:12.171979 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f24c38a-8b69-45ff-a677-bab248b42e3b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:12.172455 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-2f24c38a-8b69-45ff-a677-bab248b42e3b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:12.200342 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-2f24c38a-8b69-45ff-a677-bab248b42e3b tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/74407e8c-9e45-457c-b3d8-311ec1eb8610" status: 200 len: 194 microversion: 2.1 time: 0.041999 Aug 05 20:16:12.200916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 600/1197] 10.222.0.95 () {58 vars in 1413 bytes} [Fri Aug 5 20:16:12 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/74407e8c-9e45-457c-b3d8-311ec1eb8610 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:12.211807 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:12.212304 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:12.218273 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:12.218757 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:12.220169 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:12.220962 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:12.221422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:12.221855 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:12.303794 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lazy-loading 'services' on Instance uuid 2e9837a4-5af5-4ecf-9f3b-06aad334d879 {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:16:12.373689 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-a8ecdb16-babc-4652-8f0d-0535e50941e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "DELETE /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/74407e8c-9e45-457c-b3d8-311ec1eb8610" status: 202 len: 0 microversion: 2.1 time: 0.165760 Aug 05 20:16:12.374274 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 598/1198] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:16:12 2022] DELETE /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/74407e8c-9e45-457c-b3d8-311ec1eb8610 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:16:13.494266 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-67d2de78-03c9-4806-8fa9-c4b908d5f453 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:13.494814 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-67d2de78-03c9-4806-8fa9-c4b908d5f453 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:13.501048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67d2de78-03c9-4806-8fa9-c4b908d5f453 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:13.501524 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67d2de78-03c9-4806-8fa9-c4b908d5f453 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:13.501958 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67d2de78-03c9-4806-8fa9-c4b908d5f453 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:13.502642 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67d2de78-03c9-4806-8fa9-c4b908d5f453 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:13.503098 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67d2de78-03c9-4806-8fa9-c4b908d5f453 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:13.503520 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-67d2de78-03c9-4806-8fa9-c4b908d5f453 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:13.532780 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-67d2de78-03c9-4806-8fa9-c4b908d5f453 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/781f12de-ec9c-4275-99c9-db8efd448b09" status: 200 len: 194 microversion: 2.1 time: 0.042271 Aug 05 20:16:13.533359 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 601/1199] 10.222.0.95 () {58 vars in 1413 bytes} [Fri Aug 5 20:16:13 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/781f12de-ec9c-4275-99c9-db8efd448b09 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:13.544545 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:13.545133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:13.551280 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:13.551763 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:13.552237 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:13.552932 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:13.553390 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:13.553819 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:13.636231 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.objects.instance [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lazy-loading 'services' on Instance uuid 2e9837a4-5af5-4ecf-9f3b-06aad334d879 {{(pid=118174) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:16:13.711061 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e2efb1b7-eff4-451b-a9c5-13a534e961c6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "DELETE /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/781f12de-ec9c-4275-99c9-db8efd448b09" status: 202 len: 0 microversion: 2.1 time: 0.171081 Aug 05 20:16:13.711617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 599/1200] 10.222.0.95 () {58 vars in 1416 bytes} [Fri Aug 5 20:16:13 2022] DELETE /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments/781f12de-ec9c-4275-99c9-db8efd448b09 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:16:14.878082 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-891a2409-c102-49a0-a5f5-2838940bad24 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:14.880283 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-891a2409-c102-49a0-a5f5-2838940bad24 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:14.886770 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-891a2409-c102-49a0-a5f5-2838940bad24 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:14.887259 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-891a2409-c102-49a0-a5f5-2838940bad24 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:14.887708 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-891a2409-c102-49a0-a5f5-2838940bad24 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:14.888458 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-891a2409-c102-49a0-a5f5-2838940bad24 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:14.888916 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-891a2409-c102-49a0-a5f5-2838940bad24 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:14.889345 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-891a2409-c102-49a0-a5f5-2838940bad24 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:14.919048 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-891a2409-c102-49a0-a5f5-2838940bad24 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045778 Aug 05 20:16:14.919608 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 602/1201] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:16:14 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:16:15.032409 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-5164d4fc-334c-4352-8f55-bb005c21dbfb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:15.034615 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-5164d4fc-334c-4352-8f55-bb005c21dbfb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:15.040741 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5164d4fc-334c-4352-8f55-bb005c21dbfb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:15.041216 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5164d4fc-334c-4352-8f55-bb005c21dbfb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:15.041647 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5164d4fc-334c-4352-8f55-bb005c21dbfb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:15.042331 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5164d4fc-334c-4352-8f55-bb005c21dbfb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:15.042778 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5164d4fc-334c-4352-8f55-bb005c21dbfb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:15.043198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-5164d4fc-334c-4352-8f55-bb005c21dbfb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:15.071863 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-5164d4fc-334c-4352-8f55-bb005c21dbfb tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044768 Aug 05 20:16:15.072412 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 600/1202] 10.222.0.95 () {58 vars in 1302 bytes} [Fri Aug 5 20:16:15 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:16:15.133931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:15.134124 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:15.140019 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:15.140505 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:15.141007 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:15.141726 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:15.142183 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:15.142612 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:15.166816 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Going to try to terminate instance {{(pid=118175) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:16:15.244270 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-81a63e3a-710a-467c-90dd-726dc5fd076f tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "DELETE /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 204 len: 0 microversion: 2.1 time: 0.114159 Aug 05 20:16:15.244861 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 603/1203] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:16:15 2022] DELETE /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:16:15.255102 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:15.255720 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:15.261605 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:15.262095 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:15.262531 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:15.263220 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:15.263677 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:15.264138 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:15.399073 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:15.407739 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-b1d0ccb4-ba31-4794-971a-1ed6fe8f9f59 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1673 microversion: 2.1 time: 0.158380 Aug 05 20:16:15.408321 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 601/1204] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:15 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:16.429998 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:16.430707 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:16.437056 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:16.437721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:16.438164 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:16.438852 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:16.439304 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:16.439725 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:16.568330 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.policy [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118175) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:16.576032 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-dd45244a-e6ed-448d-a6d7-4134627f0476 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1673 microversion: 2.1 time: 0.150210 Aug 05 20:16:16.576593 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 604/1205] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:16 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:17.597437 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:17.598035 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:17.604479 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:17.604960 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:17.605389 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:17.606087 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:17.606538 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:17.606966 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:17.851324 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.policy [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff2581168d4498ad3823ed3e4ff3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f34fc2ca3d4b32be53a5658100a336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118174) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:17.859064 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-e21c045b-aeb9-4c74-8365-1adfc5b2b753 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 200 len: 1673 microversion: 2.1 time: 0.265482 Aug 05 20:16:17.860259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 602/1206] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:17 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 1673 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:16:18.080657 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [req-e3cb9945-9ac2-49c5-896d-a37fca43f0a3 req-cf195b43-aac6-4f91-9be3-9e43e4e7a029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e9837a4-5af5-4ecf-9f3b-06aad334d879", "name": "network-vif-deleted", "tag": "868a1c61-7087-4811-a208-ec39e2da7154"}]} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:16:18.091021 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-e3cb9945-9ac2-49c5-896d-a37fca43f0a3 req-cf195b43-aac6-4f91-9be3-9e43e4e7a029 service nova] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:18.091591 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-e3cb9945-9ac2-49c5-896d-a37fca43f0a3 req-cf195b43-aac6-4f91-9be3-9e43e4e7a029 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:18.092321 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [req-e3cb9945-9ac2-49c5-896d-a37fca43f0a3 req-cf195b43-aac6-4f91-9be3-9e43e4e7a029 service nova] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:18.105060 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.compute.server_external_events [req-e3cb9945-9ac2-49c5-896d-a37fca43f0a3 req-cf195b43-aac6-4f91-9be3-9e43e4e7a029 service nova] Creating event network-vif-deleted:868a1c61-7087-4811-a208-ec39e2da7154 for instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 on hv-cinder-85221 Aug 05 20:16:18.110713 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [req-e3cb9945-9ac2-49c5-896d-a37fca43f0a3 req-cf195b43-aac6-4f91-9be3-9e43e4e7a029 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040395 Aug 05 20:16:18.111525 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 605/1207] 10.222.0.95 () {64 vars in 1317 bytes} [Fri Aug 5 20:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:18.882056 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:18.882617 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:18.889562 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:18.890049 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:18.891198 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:18.891706 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:18.892222 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:18.892651 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:18.907163 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] HTTP exception thrown: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Request method failure captured: Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 HTTP/1.1 Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XmENK1a8ruzBUsLfzOVTzR3ZTiyIrr9LY26AWrZtU7v6mcvvePaXOFflZ4K0jF2gSue-wOAxOj5GBIZyh9nmigBWfwSVzsy5a5euDlJ1L7cxdkquOFB40nD1l4DIyzKbTmTFOvjrDGyD2G5aG9gfXjfmF1Z5YjahBDfmO7mOKpNnlo Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:16:18.909272 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 1aff2581168d4498ad3823ed3e4ff3f9 Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:18.910733 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': '2e9837a4-5af5-4ecf-9f3b-06aad334d879'} Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:18.911815 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:18.913230 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:18.914422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Returning 404 to user: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:18.914422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-05e0f861-a044-479a-bfa8-b1c75268efe9 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 404 len: 111 microversion: 2.1 time: 0.032572 Aug 05 20:16:18.914422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 603/1208] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:18 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:18.920234 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-37620bf9-e312-4133-b52e-3aa69e4d2e16 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '.version_select at 0x7f5691de3280>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:18.940053 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-37620bf9-e312-4133-b52e-3aa69e4d2e16 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-662728494" status: 202 len: 0 microversion: 2.1 time: 0.023911 Aug 05 20:16:18.940616 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 606/1209] 10.222.0.95 () {58 vars in 1218 bytes} [Fri Aug 5 20:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-662728494 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:16:21.838422 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:21.839057 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:21.845635 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:21.846117 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:21.846555 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:21.847249 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:21.847707 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:21.848166 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:21.861859 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] HTTP exception thrown: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Request method failure captured: Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 HTTP/1.1 Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XmENK1a8ruzBUsLfzOVTzR3ZTiyIrr9LY26AWrZtU7v6mcvvePaXOFflZ4K0jF2gSue-wOAxOj5GBIZyh9nmigBWfwSVzsy5a5euDlJ1L7cxdkquOFB40nD1l4DIyzKbTmTFOvjrDGyD2G5aG9gfXjfmF1Z5YjahBDfmO7mOKpNnlo Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:16:21.863381 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 1aff2581168d4498ad3823ed3e4ff3f9 Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.865133 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': '2e9837a4-5af5-4ecf-9f3b-06aad334d879'} Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:21.866077 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.867593 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.869259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Returning 404 to user: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:21.869259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-9dac7e6c-b735-4338-818e-2a8e34baaa88 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "DELETE /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 404 len: 111 microversion: 2.1 time: 0.030227 Aug 05 20:16:21.869259 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 604/1210] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:16:21 2022] DELETE /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:21.873584 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:21.874312 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 2e9837a4-5af5-4ecf-9f3b-06aad334d879] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:21.881523 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:21.882008 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:21.882446 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:21.883135 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:21.883594 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:21.884045 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:21.896978 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] HTTP exception thrown: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Request method failure captured: Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 HTTP/1.1 Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XmENK1a8ruzBUsLfzOVTzR3ZTiyIrr9LY26AWrZtU7v6mcvvePaXOFflZ4K0jF2gSue-wOAxOj5GBIZyh9nmigBWfwSVzsy5a5euDlJ1L7cxdkquOFB40nD1l4DIyzKbTmTFOvjrDGyD2G5aG9gfXjfmF1Z5YjahBDfmO7mOKpNnlo Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:16:21.898588 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 1aff2581168d4498ad3823ed3e4ff3f9 Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.900499 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '2e9837a4-5af5-4ecf-9f3b-06aad334d879'} Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:21.901329 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. Aug 05 20:16:21.902665 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:21.903914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Returning 404 to user: Instance 2e9837a4-5af5-4ecf-9f3b-06aad334d879 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:21.903914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ace068a9-a958-4721-a8cb-b3722366e9e6 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879" status: 404 len: 111 microversion: 2.1 time: 0.030942 Aug 05 20:16:21.903914 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 607/1211] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:21 2022] GET /compute/v2.1/servers/2e9837a4-5af5-4ecf-9f3b-06aad334d879 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:16:23.042103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:23.042588 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.compute.api [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118174) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:23.049789 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:23.050277 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:23.050717 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:23.051414 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:23.051901 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:23.052330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG oslo_concurrency.lockutils [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:23.065433 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] HTTP exception thrown: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Request method failure captured: Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 HTTP/1.1 Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7XmENK1a8ruzBUsLfzOVTzR3ZTiyIrr9LY26AWrZtU7v6mcvvePaXOFflZ4K0jF2gSue-wOAxOj5GBIZyh9nmigBWfwSVzsy5a5euDlJ1L7cxdkquOFB40nD1l4DIyzKbTmTFOvjrDGyD2G5aG9gfXjfmF1Z5YjahBDfmO7mOKpNnlo Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:16:23.066942 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 1aff2581168d4498ad3823ed3e4ff3f9 Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: > Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.069103 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': '0bd18fa6-7db0-4b85-a28a-3ddb1f058787'} Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:23.070044 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.071546 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.074330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Returning 404 to user: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:23.074330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-09d256bb-9ae4-4657-810a-067674d0415e tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "DELETE /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 404 len: 111 microversion: 2.1 time: 0.030181 Aug 05 20:16:23.074330 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 605/1212] 10.222.0.95 () {58 vars in 1239 bytes} [Fri Aug 5 20:16:23 2022] DELETE /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:23.076929 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Calling method '>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:23.077611 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.compute.api [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] [instance: 0bd18fa6-7db0-4b85-a28a-3ddb1f058787] Fetching instance by UUID {{(pid=118175) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:23.084527 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:23.085015 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:23.085474 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:23.086375 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Acquiring lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:23.086721 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:23.087153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG oslo_concurrency.lockutils [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Lock "3ed7617f-5387-4a2b-bdb9-a5bf1b1ee73e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:23.103254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] HTTP exception thrown: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Request method failure captured: Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 HTTP/1.1 Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7XmENK1a8ruzBUsLfzOVTzR3ZTiyIrr9LY26AWrZtU7v6mcvvePaXOFflZ4K0jF2gSue-wOAxOj5GBIZyh9nmigBWfwSVzsy5a5euDlJ1L7cxdkquOFB40nD1l4DIyzKbTmTFOvjrDGyD2G5aG9gfXjfmF1Z5YjahBDfmO7mOKpNnlo Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:16:23.104813 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d3f34fc2ca3d4b32be53a5658100a336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: d3f34fc2ca3d4b32be53a5658100a336 Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1037793061 Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 1aff2581168d4498ad3823ed3e4ff3f9 Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-AttachVolumeTestJSON-1037793061-project Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: > Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.106522 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '0bd18fa6-7db0-4b85-a28a-3ddb1f058787'} Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:23.107397 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. Aug 05 20:16:23.109017 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:23.111229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] Returning 404 to user: Instance 0bd18fa6-7db0-4b85-a28a-3ddb1f058787 could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:23.111229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-fe67013b-8500-428f-97cf-5fc387094096 tempest-AttachVolumeTestJSON-1037793061 tempest-AttachVolumeTestJSON-1037793061-project] 10.222.0.95 "GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787" status: 404 len: 111 microversion: 2.1 time: 0.033138 Aug 05 20:16:23.111229 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 608/1213] 10.222.0.95 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:23 2022] GET /compute/v2.1/servers/0bd18fa6-7db0-4b85-a28a-3ddb1f058787 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:27.425311 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-8760ab11-8777-4f3f-b124-9c0ef0174b58 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Action: 'create', calling method: .version_select at 0x7f5691d419d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-4175643"}} {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:16:27.715114 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-8760ab11-8777-4f3f-b124-9c0ef0174b58 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 200 len: 342 microversion: 2.1 time: 0.407998 Aug 05 20:16:27.715732 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 606/1214] 10.222.0.95 () {60 vars in 1155 bytes} [Fri Aug 5 20:16:27 2022] POST /compute/v2.1/os-volumes => generated 342 bytes in 409 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 20:16:27.728735 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-76bfec6f-5bfc-4015-82fb-9bc2a0c6ea61 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691d30c10>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:27.780513 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-76bfec6f-5bfc-4015-82fb-9bc2a0c6ea61 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d" status: 200 len: 342 microversion: 2.1 time: 0.055490 Aug 05 20:16:27.781077 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 609/1215] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:27 2022] GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d => generated 342 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:28.794371 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-073f0738-6125-412a-9f52-e334aceadcf3 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691e388b0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:28.841117 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-073f0738-6125-412a-9f52-e334aceadcf3 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d" status: 200 len: 343 microversion: 2.1 time: 0.050971 Aug 05 20:16:28.841681 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 607/1216] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:28 2022] GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d => generated 343 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:28.854902 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-8e2d8c96-907d-4f06-8293-225728ce6b5d tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Action: 'create', calling method: .version_select at 0x7f5691c300d0>, body: {"snapshot": {"volume_id": "92c3f7e6-72fa-4505-829e-5f4687f0f86d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-300270361"}} {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:16:29.008613 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-8e2d8c96-907d-4f06-8293-225728ce6b5d tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.157878 Aug 05 20:16:29.009480 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 610/1217] 10.222.0.95 () {60 vars in 1162 bytes} [Fri Aug 5 20:16:28 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:29.021634 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-0ee86439-5431-400f-b8f7-09b562346bf4 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f56926b54c0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:29.057704 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-0ee86439-5431-400f-b8f7-09b562346bf4 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f" status: 200 len: 286 microversion: 2.1 time: 0.040693 Aug 05 20:16:29.058325 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 608/1218] 10.222.0.95 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:29 2022] GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:29.070186 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-f0254d23-b24e-4664-b015-6ffc292ed36a tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691c10d30>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:29.101684 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-f0254d23-b24e-4664-b015-6ffc292ed36a tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035452 Aug 05 20:16:29.102475 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 611/1219] 10.222.0.95 () {58 vars in 1140 bytes} [Fri Aug 5 20:16:29 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:29.113939 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2d1b5d25-75bb-465f-95d3-cc78a07d9298 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5692753a60>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:29.143544 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2d1b5d25-75bb-465f-95d3-cc78a07d9298 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f" status: 200 len: 286 microversion: 2.1 time: 0.033807 Aug 05 20:16:29.144137 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 609/1220] 10.222.0.95 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:29 2022] GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:30.156366 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-1e417f5e-4226-4932-b6e2-469479bdd7cd tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691e0e940>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:30.188496 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-1e417f5e-4226-4932-b6e2-469479bdd7cd tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f" status: 200 len: 286 microversion: 2.1 time: 0.035710 Aug 05 20:16:30.189131 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 612/1221] 10.222.0.95 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:30 2022] GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:31.201569 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-7d07937d-5548-4fd4-8310-563df4cf2a6b tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691e381f0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:31.231856 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-7d07937d-5548-4fd4-8310-563df4cf2a6b tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f" status: 200 len: 286 microversion: 2.1 time: 0.034540 Aug 05 20:16:31.232406 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 610/1222] 10.222.0.95 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:31 2022] GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:32.245190 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-91047188-283c-451f-8af7-91a8d541091c tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5693b8adc0>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:32.275216 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-91047188-283c-451f-8af7-91a8d541091c tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f" status: 200 len: 287 microversion: 2.1 time: 0.034245 Aug 05 20:16:32.275770 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 613/1223] 10.222.0.95 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:32 2022] GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:32.287454 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-af4c9496-81df-4c67-8cff-772b349fdc14 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f56929484c0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:32.347486 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-af4c9496-81df-4c67-8cff-772b349fdc14 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "DELETE /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f" status: 202 len: 0 microversion: 2.1 time: 0.064157 Aug 05 20:16:32.348085 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 611/1224] 10.222.0.95 () {58 vars in 1254 bytes} [Fri Aug 5 20:16:32 2022] DELETE /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:16:32.356562 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-b9fa49e8-b384-4132-9052-5f55ef2f0f8c tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691f4ca60>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:32.390145 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-b9fa49e8-b384-4132-9052-5f55ef2f0f8c tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f" status: 200 len: 286 microversion: 2.1 time: 0.037732 Aug 05 20:16:32.391347 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 614/1225] 10.222.0.95 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:32 2022] GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:33.400723 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_api:SELECT=22 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:33.401477 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG dbcounter [-] [118174] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:33.405792 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ea852dcf-6587-4cc0-8883-f48c1d48d8ce tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691d36280>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:33.432349 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-ea852dcf-6587-4cc0-8883-f48c1d48d8ce tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] HTTP exception thrown: Snapshot 9282b093-01f6-4b12-a293-42683430870f could not be found. Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ea852dcf-6587-4cc0-8883-f48c1d48d8ce tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Request method failure captured: Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f HTTP/1.1 Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7Xqb6YpyAYyVnXFg0aePE88pDV3c1L5uOMOc6KhZ4qsQTn40PWmqPIs_-3ZdT6tSkyLLySvX4qcU2yJoWJh3HbeyFsYA0heiOrRMWEmyEsiW9OYfZ7EKRhDA6fyF-nfrH5uthBunLRRz37hkR-210V2qj7-U5a4lbhSgui71BAFCrg4 Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 5def2eb6b4e047c8890f3b43f7062e70 Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:16:33.434991 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 5def2eb6b4e047c8890f3b43f7062e70 Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-VolumesSnapshotsTestJSON-1338314740-project Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 9f1b068b2d5c41e29288be905b2cbb87 Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1338314740-project Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Snapshot 9282b093-01f6-4b12-a293-42683430870f could not be found. Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': '9282b093-01f6-4b12-a293-42683430870f'} Aug 05 20:16:33.436728 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9282b093-01f6-4b12-a293-42683430870f could not be found. (HTTP 404) (Request-ID: req-dc35c1b3-41cb-4c99-8df3-47a375d57d52) Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:33.438336 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:33.440012 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9282b093-01f6-4b12-a293-42683430870f could not be found. Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 20:16:33.441637 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9282b093-01f6-4b12-a293-42683430870f could not be found. Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9282b093-01f6-4b12-a293-42683430870f could not be found. Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-ea852dcf-6587-4cc0-8883-f48c1d48d8ce tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Returning 404 to user: Snapshot 9282b093-01f6-4b12-a293-42683430870f could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:33.443190 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-ea852dcf-6587-4cc0-8883-f48c1d48d8ce tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f" status: 404 len: 111 microversion: 2.1 time: 0.036727 Aug 05 20:16:33.444403 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 612/1226] 10.222.0.95 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:33 2022] GET /compute/v2.1/os-snapshots/9282b093-01f6-4b12-a293-42683430870f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:33.445066 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0c600af1-085b-413f-9640-c4c3f9193ca6 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f56921524c0>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:33.451160 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:33.451926 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG dbcounter [-] [118175] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:33.508201 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0c600af1-085b-413f-9640-c4c3f9193ca6 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d" status: 202 len: 0 microversion: 2.1 time: 0.066782 Aug 05 20:16:33.508758 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 615/1227] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:16:33 2022] DELETE /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:16:33.516922 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2e0e3827-2a3e-4e98-bc9a-6ec73f9d1981 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f56929488b0>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:33.566813 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2e0e3827-2a3e-4e98-bc9a-6ec73f9d1981 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d" status: 200 len: 342 microversion: 2.1 time: 0.053689 Aug 05 20:16:33.567405 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 613/1228] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:33 2022] GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d => generated 342 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:34.582052 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0da95dbb-bb72-4d46-a8f2-757ff8d40bf9 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691f4c670>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:34.611189 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-0da95dbb-bb72-4d46-a8f2-757ff8d40bf9 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] HTTP exception thrown: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0da95dbb-bb72-4d46-a8f2-757ff8d40bf9 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Request method failure captured: Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d HTTP/1.1 Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7Xqb6YpyAYyVnXFg0aePE88pDV3c1L5uOMOc6KhZ4qsQTn40PWmqPIs_-3ZdT6tSkyLLySvX4qcU2yJoWJh3HbeyFsYA0heiOrRMWEmyEsiW9OYfZ7EKRhDA6fyF-nfrH5uthBunLRRz37hkR-210V2qj7-U5a4lbhSgui71BAFCrg4 Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 5def2eb6b4e047c8890f3b43f7062e70 Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:16:34.613252 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 5def2eb6b4e047c8890f3b43f7062e70 Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-VolumesSnapshotsTestJSON-1338314740-project Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 9f1b068b2d5c41e29288be905b2cbb87 Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1338314740-project Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '92c3f7e6-72fa-4505-829e-5f4687f0f86d'} Aug 05 20:16:34.614934 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. (HTTP 404) (Request-ID: req-28ca7ac6-f98e-4aba-a77e-c78a259738dd) Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:34.616014 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:34.617269 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:16:34.618478 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-0da95dbb-bb72-4d46-a8f2-757ff8d40bf9 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Returning 404 to user: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-0da95dbb-bb72-4d46-a8f2-757ff8d40bf9 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d" status: 404 len: 109 microversion: 2.1 time: 0.037647 Aug 05 20:16:34.619719 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 616/1229] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:34 2022] GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:34.630074 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2b219de7-37b1-47c0-a93f-b7c6c85f50aa tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691e28550>' {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:34.657491 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.wsgi [None req-2b219de7-37b1-47c0-a93f-b7c6c85f50aa tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] HTTP exception thrown: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2b219de7-37b1-47c0-a93f-b7c6c85f50aa tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Request method failure captured: Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: request: DELETE /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d HTTP/1.1 Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept: application/json Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Accept-Encoding: identity Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Connection: close Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Length: 0 Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Content-Type: application/json Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Host: 10.222.0.95 Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Openstack-System-Scope: None Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Auth-Token: gAAAAABi7Xqb6YpyAYyVnXFg0aePE88pDV3c1L5uOMOc6KhZ4qsQTn40PWmqPIs_-3ZdT6tSkyLLySvX4qcU2yJoWJh3HbeyFsYA0heiOrRMWEmyEsiW9OYfZ7EKRhDA6fyF-nfrH5uthBunLRRz37hkR-210V2qj7-U5a4lbhSgui71BAFCrg4 Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Id: None Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Domain-Name: None Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Identity-Status: Confirmed Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Is-Admin-Project: True Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Id: default Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Domain-Name: Default Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Id: 5def2eb6b4e047c8890f3b43f7062e70 Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Role: reader,member Aug 05 20:16:34.659764 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Roles: reader,member Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Id: 5def2eb6b4e047c8890f3b43f7062e70 Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User: tempest-VolumesSnapshotsTestJSON-1338314740-project Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Id: default Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Domain-Name: Default Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Id: 9f1b068b2d5c41e29288be905b2cbb87 Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1338314740-project Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: method: Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: exception: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: action_args: {'id': '92c3f7e6-72fa-4505-829e-5f4687f0f86d'} Aug 05 20:16:34.661559 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: {{(pid=118174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. (HTTP 404) (Request-ID: req-ca1fc9a4-9c5f-49c4-8c4d-f19040182e91) Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:34.662626 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:16:34.664201 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 20:16:34.665759 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: DEBUG nova.api.openstack.wsgi [None req-2b219de7-37b1-47c0-a93f-b7c6c85f50aa tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Returning 404 to user: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. {{(pid=118174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:34.667335 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO nova.api.openstack.requestlog [None req-2b219de7-37b1-47c0-a93f-b7c6c85f50aa tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d" status: 404 len: 109 microversion: 2.1 time: 0.036066 Aug 05 20:16:34.668492 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: [pid: 118174|app: 0|req: 614/1230] 10.222.0.95 () {58 vars in 1248 bytes} [Fri Aug 5 20:16:34 2022] DELETE /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:34.670505 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ebd67214-0645-48c2-a19b-4cc091b3f3b8 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Calling method '.version_select at 0x7f5691f4c670>' {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:34.699153 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.wsgi [None req-ebd67214-0645-48c2-a19b-4cc091b3f3b8 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] HTTP exception thrown: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ebd67214-0645-48c2-a19b-4cc091b3f3b8 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Request method failure captured: Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: request: GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d HTTP/1.1 Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept: application/json Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Accept-Encoding: identity Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Connection: close Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Length: 0 Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Content-Type: application/json Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Host: 10.222.0.95 Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Openstack-System-Scope: None Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Auth-Token: gAAAAABi7Xqb6YpyAYyVnXFg0aePE88pDV3c1L5uOMOc6KhZ4qsQTn40PWmqPIs_-3ZdT6tSkyLLySvX4qcU2yJoWJh3HbeyFsYA0heiOrRMWEmyEsiW9OYfZ7EKRhDA6fyF-nfrH5uthBunLRRz37hkR-210V2qj7-U5a4lbhSgui71BAFCrg4 Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Id: None Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Domain-Name: None Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Identity-Status: Confirmed Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Is-Admin-Project: True Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Id: default Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Domain-Name: Default Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Id: 5def2eb6b4e047c8890f3b43f7062e70 Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Role: reader,member Aug 05 20:16:34.701134 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Roles: reader,member Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/5def2eb6b4e047c8890f3b43f7062e70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Id: 5def2eb6b4e047c8890f3b43f7062e70 Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1338314740 Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User: tempest-VolumesSnapshotsTestJSON-1338314740-project Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Id: default Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Domain-Name: Default Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Id: 9f1b068b2d5c41e29288be905b2cbb87 Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1338314740-project Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: method: Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: exception: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: action_args: {'id': '92c3f7e6-72fa-4505-829e-5f4687f0f86d'} Aug 05 20:16:34.702749 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: {{(pid=118175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. (HTTP 404) (Request-ID: req-940589c9-9e1c-44ec-bce4-e6382fc14e72) Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:34.704254 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:34.706006 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:16:34.707871 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: ERROR nova.api.openstack.wsgi Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: DEBUG nova.api.openstack.wsgi [None req-ebd67214-0645-48c2-a19b-4cc091b3f3b8 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] Returning 404 to user: Volume 92c3f7e6-72fa-4505-829e-5f4687f0f86d could not be found. {{(pid=118175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO nova.api.openstack.requestlog [None req-ebd67214-0645-48c2-a19b-4cc091b3f3b8 tempest-VolumesSnapshotsTestJSON-1338314740 tempest-VolumesSnapshotsTestJSON-1338314740-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d" status: 404 len: 109 microversion: 2.1 time: 0.035800 Aug 05 20:16:34.709415 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: [pid: 118175|app: 0|req: 617/1231] 10.222.0.95 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:34 2022] GET /compute/v2.1/os-volumes/92c3f7e6-72fa-4505-829e-5f4687f0f86d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:17:46.425206 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:17:46.425810 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Fri Aug 5 20:17:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:18:36.903901 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:18:36.904520 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Fri Aug 5 20:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:19:18.107258 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:19:18.107967 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Fri Aug 5 20:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:19:27.582785 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:19:27.583413 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Fri Aug 5 20:19:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:21:06.434273 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:21:06.434778 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Fri Aug 5 20:21:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:21:19.353238 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:21:19.353924 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Fri Aug 5 20:21:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:21:20.720080 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:21:20.720931 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Fri Aug 5 20:21:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:21:56.912364 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:21:56.912946 dv-cinder-852211-3-iscsi devstack@n-api.service[118174]: Fri Aug 5 20:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:22:38.116065 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:22:38.116705 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Fri Aug 5 20:22:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:22:47.590965 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:22:47.591772 dv-cinder-852211-3-iscsi devstack@n-api.service[118175]: Fri Aug 5 20:22:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!